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Preface 


This book is based on lectures given by the first author at Cal Poly Pomona, 
Arizona State University (ASU), and the Massachusetts Institute of Technol- 
ogy (MIT), and by the second author at Western Kentucky University (WKU) 
and California State Polytechnic University-Pomona (Cal Poly Pomona). The 
text can be used for a traditional one-semester sophomore-level course in or- 
dinary differential equations (such as WKU’s MATH 331). However, there 
is ample material for a two-quarter sequence (such as Cal Poly Pomona’s 
MAT 216-431), as well as sufficient linear algebra in the text so that it can be 
used for a one-quarter course that combines differential equations and linear 
algebra (such as Cal Poly Pomona Math 224), or a one-semester course in 
differential equations that brings in linear algebra in a significant way (such 
as ASU’s MAT 275 or MIT’s 18.03 without the PDEs). Most significantly, 
computer labs are given in MATLAB®,! Maple™, and Mathematica at the 
end of each chapter so the book may be used for a course to introduce and 
equip the student with a knowledge of the given software (such as ASU’s MAT 
275). Near the end of this Preface, we give some sample course outlines that 
will help show the independence of various sections and chapters. The focus 
of the text is on applications and methods of solution, both analytical and 
numerical, with emphasis on methods used in the typical engineering, physics, 
or mathematics student’s field of study. We have tried to provide sufficient 
problems of a mathematical nature at the end of each section so that even the 
pure math major will be sufficiently challenged. 


Key Features 


This second edition of the book keeps many of the key features from the 
first edition: 


e MATLAB, Maple, and Mathematica are incorporated at the end of each 
chapter, helping students with pages of tedious algebra and many of 
the differential equations topics; the goal of the software is still to show 


IMATLAB is a registered trademark of The MathWorks, Inc. For product information, 
please contact: 

The Mathworks, Inc. 

3 Apple Hill Drive 

Natick, MA, 01760-2098 USA 

Tel: 508-647-7000 

Fax: 508-647-7001 

E-mail: info@mathworks.com 

Web: www.mathworks.com 
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students how to make informed use of the relevant software in the field; 
all three software packages have parallel code and exercises; 

There are numerous problems of varying difficulty for both the applied 
and pure math major, as well as problems for the nonmathematician 
(engineers, etc.); 

An appendix that gives the reader a “crash course” in the three software 
packages; no prior knowledge is assumed; 

Answers to most of the odd problems in the back of the book; 

Chapter reviews at the end of each chapter to help the students review; 
Projects at the end of each chapter that go into detail about certain topics 
and sometimes introduce new topics that the students are now ready to 
see; 

An appendix on linear algebra to supplement the treatment within the 
text, should it be appropriate for the reader/course; 

A full solutions manual for the qualified instructor. 


It also incorporates new features, many of which have been suggested by 
professors and students who have taught/learned from the first edition: 


The computer codes are moved to the end of each chapter as Computer 
Labs to facilitate reading of the book by students and professors who 
either choose not to use the technology or who do not have access to it 
immediately; 

The latest software versions are used; significant changes have occurred 
in certain aspects of MATLAB, Maple, and Mathematica since the first 
edition in 2006, and the relevant changes are incorporated; 

Much of the linear algebra discussion has been moved to Chapter 5 (from 
Chapter 3), which deals with linear systems; 

Sections have been added on complex variables (Chapter 3), the expo- 
nential response formula for solving nonhomogeneous equations (Chapter 
4), forced vibrations (Chapter 4) as well as a subsection on nondimen- 
sionalization (Chapter 2), and a combining of the sections on Euler and 
Runge-Kutta methods (Chapter 2); 

Many rewritten sections highlight applications and modeling within many 
fields; 

Exercises flow from easiest to hardest; 

Color graphs to help the reader better understand crucial concepts in 
ordinary differential equations; 

Updated and extended projects at the end of each chapter to reflect 
changes within the chapters. 


Approaches to Teaching Ordinary Differential Equations 


The second edition of this book has evolved with our understanding of how 
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to teach the material in the best possible way. Some notable examples from 
the above list: 


1. The structure of the course in covering linear systems in their entirety 
before covering applications to nonlinear systems (phase plane, etc.) was 
a direct result of numerous conversations with MIT’s Professor Haynes 
Miller (who frequently teaches MIT’s 18.03) as was the incorporation of 
the new sections on essential topics from complex variables, exponential 
response and complex replacement (developed by Haynes) for solving 
nonhomogeneous differential equations, and the s-domain and poles as 
an important use of Laplace transforms by engineers. 

2. Combining the computer codes into Computer Labs at the end of each 
section rather than having snippets of code embedded throughout the 
text was a direct result of a switch in ASU’s method of teaching this 
course. Setting aside six class periods for such labs is the way differential 
equations is now taught at ASU. 

3. The presentation of essential linear algebra topics to aid in the under- 
standing of differential equations was helped by discussions with MIT’s 
Professor Gil Strang as well as seeing some of his lectures firsthand. 


Most differential equations we have encountered in practice have needed ana- 
lytical approximations or numerical approximations to gain insight into their 
behavior. We don’t feel that students use technology wisely if they simply ask 
the computer to solve a given problem. We thus focus on what we consider 
to be the basics necessary for adequately preparing a student for study in her 
or his respective fields, including mathematics. We present the syntax from 
MATLAB, Maple, and Mathematica in Computer Labs at the end of each 
chapter. We feel that this provides the readers a better understanding of the 
theory and allows them to gain more insight into real-world problems they 
are likely to encounter. The vast majority of our students also have no pre- 
vious experience with MATLAB, Maple, or Mathematica and we start from 
the basics and teach informed use of the relevant mathematical software. The 
student whom we “typically encounter” has had one year of calculus and is 
usually a major in a field other than pure mathematics. 

Our book is traditional in its approach and coverage of basic topics in 
ordinary differential equations. However, we cover a number of “modern” 
topics such as direction fields, phase lines, the Runge-Kutta method, and 
nondimensionalization in Chapter 2 and epidemiological and ecological models 
in Chapter 6. As mentioned earlier, we also bring elements from linear algebra, 
such as eigenvectors, bases, and transformations, in order to best equip the 
reader of the book for a solid understanding of the material. Besides the 
Computer Labs there are also Projects at the end of each chapter that give 
useful insight into past and future topics covered in the book. The topics 
covered in these projects include a mix of traditional, modeling, numerical, 
and linear algebra aspects of ordinary differential equations. It is the intent 
that students who study this book and work most of the problems contained 
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in these pages will be very prepared to continue their studies in engineering 
and mathematics. 


Some Sample Course Outlines 


While we could not begin to prescribe how this book may best be used 
for each school, we include some possible sections covered for various course 
outlines. We stress that if you intend to incorporate MATLAB, Maple, or 
Mathematica into your course, it is crucial to assign Exercises 1-4 (plus a 
few others) from Appendix A and the Chapter 1 Computer Lab early in the 
course. Appendix A only requires a knowledge of college algebra and some 
calculus (Taylor series) while Chapter 1 Computer Lab requires a knowledge 
of calculus as it is applied to differential equations. Thus both can be assigned 
within the first 2 weeks of the course (and likely together). 


Traditional semester ODE course: 
Chap. 1 | Chap. 2 | Chap. 3 | Chap. 4 | Chap. 5 | Chap. 7 | Chap. 8 


1.1-1.6 | 2.1-2.2 | 3.1-3.3 | 4.1, 4.3 5.1 7.1-7.4 | 8.1-8.5 
3.5-3.6 | 4.5-4.6 | 5.4-5.8 


Semester ODE course with modeling or application emphasis: 


Chap. 1 | Chap. 2 | Chap. 3 | Chap. 4 | Chap. 5 | Chap. 6 | Chap. 7 
1.1-1.4 | 2.1-26 | 3.1-3.2 | 4.1-4.2 | 5.1,5.4 | 6.1-6.5 | 7.1-7.5 
3.4-3.7 | 4.4-4.7 | 5.5, 5.7 


Semester ODE course with linear algebra emphasis and no separate 
computer labs: 


Ch.1 | Ch.2 | Ch.3 | Ch.4 ) Ch.5 | Ch. 6 | Ch. 7 | App. B 
1.1-1.4 | 2.1-2.2 | 3.1-3.2 | 4.1-4.2 | 5.1-5.5 | 6.1 | 7.1-7.7 | B.1-B.4 
2.5 3.4-3.7 | 4.4, 4.7 | 5.7-5.8 


Semester ODE course with linear algebra emphasis and 6 computer 
labs: 
Ch. 1 | Ch.2 | Ch.3 | Ch.4 | Ch.5 | Ch. 7 | Comp. Labs | 
1.1-1.4 | 2.1-2.2 | 3.1-3.2 | 4.1-4.2 | 5.1-5.5 | 7.1-7.6 | A& 1, 2, | 


2.5 | 3.43.7 | 4.4, 4.7 3, 4, 58&B, 7 


Quarter ODE course with linear algebra emphasis: 


Ch. 1 | Ch.2 | Ch.3 | Ch.4 | Ch.5 | App.B | 
L114] 21-22 131-32 | 41-42 [51-55 | B.1-B4 | 
25 [343.7] 47 


Acknowledgments 


Students, with their questions both in-class and during office hours, helped 
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revising the solutions manual. 
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exercises, and projects have been collected over many years for various courses 
taught by both authors. Some were taken from others’ textbooks and papers. 
We have tried to give proper credit throughout this text; however, it was not 
always possible to properly acknowledge the original sources. It is our hope 
that we repay this explicit debt to earlier writers by contributing our (and 
their) ideas to further student understanding of differential equations. 

We particularly wish to thank our production coordinator, Jessica Vakili, as 
well as Michele Dimont, Amy Blalock, Hayley Ruggieri, and Sherry Thomas. 
Bob Stern and Bob Ross, our editors at Chapman & Hall/CRC Press, both 
deserve a big thanks for believing in this project and for helpful guidance, 
advice and patience. We sincerely thank all these individuals; without their 
assistance this text would not have succeeded. 
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Finally, we would appreciate any comments that you might have regarding 


this book. 
oe Stephen A. Wirkus (e-mail: swirkus@asu. edu) 


Randall J. Swift (e-mail: rjswift@csupomona. edu) 


From the first edition: 


We owe a very special thanks to Erika Camacho (Arizona State University) 
for her help in writing the MATLAB and Maple code for this book and for de- 
tailed suggestions on numerous sections. John Fay and Gary Etgen reviewed 
earlier drafts of this text and provided helpful feedback. Scott Wilde pro- 
vided valuable assistance in writing and preparing the solutions manual for 
the book. We owe a big thanks to our former students David Monarres, for 
help in preparing portions of this book, and Walter Sosa and Moore Chung, 
for their help in preparing solutions. We would also like to acknowledge our 
Cal Poly Pomona colleagues Michael Green, Jack Hofer, Tracy McDonald, Jim 
McKinney, Siew-Ching Pye, Dick Robertson, Paul Salomaa, Jenny Switkes, 
Karen Vaughn, and Mason Porter (Caltech/Oxford) for their willingness to 
use draft versions of this text in their courses and their important suggestions, 


xvi Preface 


which improved the overall readability of the text. The faculty and students of 
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of the computer code. Mary Jane Hill assisted us with certain aspects of the 
text and helped in typesetting some of the chapters of the initial drafts of the 
book; her effort is greatly appreciated. The production and support staff at 
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to thank our project coordinator Theresa Del Forn and project editor Pru- 
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A few remarks for students and professors: 


This book will succeed if any fears and reservations about learning one of the 
three computer algebra systems used in this book are put aside. Computers 
are not here to supplant us, but rather they are here to help illustrate and 
illuminate concepts and insights that we have. Nothing is foolproof and we 
stress the importance of informed use of the relevant mathematical software. 
Numerical answers, although quite accurate most of the time, should always 
be examined carefully because computers are as smart as the programmer 
allows them to be. There should never be a blind trust in an answer. 

It is essential that the technology that you choose—MATLAB, Maple, or 
Mathematica—be introduced early in the class, just as it is introduced early in 
the book. While certain mathematical software packages may be better suited 
for studying differential equations, none have the versatility that the above 
three programs have to give insight into other areas of mathematics. The two 
keys to learning the programs are (1) learning the syntax and (2) learning to 
use the help menus to figure out some of the commands. Setting aside one 
class, for example, to give a brief tutorial on one of these software packages in 
the computer lab is a very worthwhile investment. It is by no means necessary 
and the typical student will be able to learn the material on his/her own by 
carefully following Appendix A. For reinforcement, it is crucial to include at 
least one or two technology problems with each homework assignment. The 
conscientious student will be well prepared to use the same software package 
in any upper division course in any branch of the mathematical sciences and 
its applications. 

It is not necessary to bring computer demonstrations into the classroom. 
Both authors have taught their courses successfully without classroom demon- 
strations; handouts sometimes are useful, especially from the appendices. The 
students, for better or worse, are generally far less afraid of technology than 
one might expect. If students are sent to the computer lab with an assign- 
ment to do and aided with Appendix A, the vast majority will come back 
with satisfactory answers. Yes, you may bang your head against your desk 
in frustration at times, but just ask the person next to you for help and also 
seek the help menus and you will be able to learn MATLAB, Maple, and 
Mathematica quite well. 


Chapter 1 


Traditional First-Order Differential 
Equations 


A Very Brief History 

The study of Differential Equations began very soon after the invention of 
Differential and Integral Calculus, to which it forms a natural sequel. In 1676 
Newton solved a differential equation by the use of an infinite series, only 
11 years after his discovery of the fluzional form of differential calculus in 
1665. These results were not published until 1693, the same year in which a 
differential equation occurred for the first time in the work of Leibniz (whose 
account of the differential calculus was published in 1684). 

In the next few years progress was rapid. In 1694-1697 John Bernoulli 
explained the method of “Separating the Variables,” and he showed how to 
reduce a homogeneous differential equation of the first order to one in which 
the variables were separable. He applied these methods to problems on or- 
thogonal trajectories. He and his brother Jacob (after whom the “Bernoulli 
Equation” is named; see Section 1.6.1) succeeded in reducing a large number 
of differential equations to forms they could solve. Integrating Factors were 
probably discovered by Euler (1734) and (independently of him) by Fontaine 
and Clairaut, though some attribute them to Leibniz. Singular Solutions, 
noticed by Leibniz (1694) and Brook Taylor (1715), are generally associated 
with the name of Clairaut (1734). The geometrical interpretation was given 
by Lagrange in 1774, but the theory in its present form was not given until 
much later by Cayley (1872) and M.J.M. Hill (1888). 

Today, differential equations are used in many different fields. They can 
often accurately capture the behavior of continuous models or a large number 
of discrete objects where the current state of the system determines the future 
behavior of the system. Such models are called deterministic (as opposed 
to stochastic or random). The study of nonlinear differential equations 
is still a very active area of research. Although this text will consider some 
nonlinear differential equations, here the focus will be on the linear case. We 
will begin with some basic terminology. 


1.1 Introduction to First-Order Equations 


Order, Linear, Nonlinear 


We begin our study of differential equations by explaining what a differen- 
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tial equation is. From our experience in calculus, we are familiar with some 
differential equations. For example, suppose that the acceleration of a falling 
object is a(t) = —32, measured in ft/sec?. Using the fact that the derivative 
of the velocity function v(t) (measured in ft/sec) is the acceleration function 
a(t), we can solve the equation 


u(t) =a(t) or e = a(t) = —32. 
dt 
Many different types of differential equations can arise in the study of familiar 
phenomena in subjects ranging from physics to biology to economics to chem- 
istry. We give examples from various fields throughout the text and engage 
the reader with many such applications. 

It is clearly necessary (and expedient) to study, independently, more re- 
stricted classes of these equations. The most obvious classification is based 
on the nature of the derivative(s) in the equation. A differential equation in- 
volving derivatives of a function of one variable (ordinary derivatives) is called 
an ordinary differential equation, whereas one containing partial deriva- 
tives of a function of more than one independent variable is called a partial 
differential equation. In this text, we will focus on ordinary differential 
equations. 

The order of a differential equation is defined as the order of the highest 
derivative appearing in the equation. 


| Example 1 | The following are examples of differential equations with indi- 


cated orders: 
(a) dy/dx = ay (First-Order) 
(b) a” (t) — 3a’(t) + x(t) = cost (second order) 
(c) (y)3/5 — 2y" = cosa (fourth order) 


where the superscript “) in (c) represents the fourth derivative. - 


Our focus will be on linear differential equations, which are those equations 
that have an unknown function, say y, and each of its higher derivatives ap- 
pearing in linear functions. That is, we do not see them as y?, yy’,siny, or 
(y\%)3/5.1 More precisely, a linear differential equation is one in which the de- 
pendent variable and its derivatives appear in additive combinations of their 
first powers. Equations where one or more of y and its derivatives appear in 
nonlinear functions are called nonlinear differential equations. In the above 
example, only (c) is a nonlinear differential equation. 


| Example 2 | Classify the equations as linear or nonlinear. 


‘Most of the equations we consider will involve an unknown function y that depends on z. 
Two other common variables used are (i) the unknown function y that depends on t and 
(ii) the unknown function x that depends on ft, the latter being used in Example 1b. 
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(a) y” + 3y’ — xy = cosx 
(b) y — 3y' +y? =0 
(c) y) + yy! + siny = x? 


Solution 
The first of these equations is linear as it consists of an additive combination 
of y, y’, and y”, each of which is raised to the first power. In contrast to this, 
the second equation is nonlinear because of the y? term. The last equation 
is nonlinear both because of the yy’ term and the sin y term—either of these 
terms by itself would have made the equation nonlinear. Our study of non- 
linear differential equations will focus on techniques for specific equations or 
on understanding the qualitative behavior of a nonlinear differential equation, 
since general techniques of solution are rarely applicable. . 
Much of this book is concerned with the solutions of linear differential 
equations. Thus we need to explain what we mean by a solution. First we 
note that any nth-order differential equation can be written in the form 


F(z, y; yyy) = 0, (1.1) 
where n is a positive integer. For example, y/ = x? + y? can be written as 
y’ _ a _ y” = 0. 


Here F(z, y,y’) = y! — x2 — y®. The second-order equation y” — 3x?y! + 5y = 
sin can be written as 


y” — 327y' + 5y — sing =0 


and we see that F(z,y,y',y”") = y" — 3z7y’ + 5y — sing. 


Definition 1.1.1 
A solution to an nth-order differential equation is a function that is n 
times differentiable and that satisfies the differential equation. Symboli- 
cally, this means that a solution of differential equation (1.1) is a function 
y(x) whose derivatives y’(x), y!(x), ...,y™ (a) exist and that satisfies the 
equation 

Eg, y(x), y (2), S63H y (x) =0 


for all values of the independent variable x in some interval (a,b) where 


GG) Gee (G)) 


is defined. (Note that the solution to a differential equation does not 
contain any derivatives, although the derivatives of this solution exist.) 
The interval (a,b) may be infinite; that is, a = —oo, or b = oo, or both. 
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|Example 3 | The function y(a) = 2e%” is a solution of the differential equa- 


tion 


ba ee 
a uy 


for « € (—oo, 00) because it satisfies the differential equation by giving an 
identity: 
dy _ ,de* 
dx dx 


Initial-Value vs. Boundary-Value Problems 

We will soon see that solving a general differential equation gives rise to a 
solution that has constants. These constants can be eliminated by specifying 
the initial state of the system or conditions that the solution must satisfy on 
its domain of definition or “boundary.” An example of the first situation is 
specifying the position and velocity of a mass on a spring. An example of the 
second is a rope hanging from two supports, given the location of these two 
supports. 


Consider a first-order differential equation 


dy _ 


and suppose that the solution y(x) was subject to the condition that y(ao) = 
yo. This is an example of an initial-value problem. The condition y(xo) = 
yo is called an initial condition and Zo is called the initial point. More 
generally, we have the following: 


Definition 1.1.2 


An initial-value problem consists of an nth-order differential equation 
together with n initial conditions of the form 


y(xo) = a0, y' (ao) = A1,-+) ie (x0) = Gail 


that must be satisfied by the solution of the differential equation and its 
derivatives at the initial point zo. 
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| Example 4 | ~ The following are examples of initial-value problems: 


(a) dy/dx = 2y — 3x, y(0) = 2 (here x = 0 is the initial point) 

(b) x” (t) +5a’(t) +sin(ta(t)) = 0, v(1) = 0,2'(1) = 7 (here t = 1 is the initial 
point). 

(Note that the differential equation in (a) is linear, whereas the equation in 
(b) is nonlinear.) We define a solution to an nth-order initial-value problem 
as a function that is n times differentiable on an interval (a,b); this satisfies 
the given differential equation on that interval, and satisfies the n, given ini- 
tial conditions with the requirement that xo € (a,b). As before, the interval 


(a,b) might be infinite. = 


In contrast to an initial-value problem, a boundary-value problem con- 
sists of a differential equation and a set of conditions at different x-values 
that the solution y(x) must satisfy. Although any number of conditions (>2) 
may be specified, usually only two are given. Rather than specifying the 
initial state of the system, we can think of a boundary-value problem as 
specifying the state of the system at two different physical locations, say 
t= 4,71 =b,a 4b. 


| Example 5 | The following are examples of boundary-value problems: 


(a) d?y/dx? + 5ry = cosz, y(0) = 0,y/(m) = 2 


(b) dy/dz + 5ay = 0,y(0) = y(1) = 2 - 


Although a boundary-value problem may not seem too different from an 
initial-value problem, methods of solution are quite varied. We will focus on 
initial-value problems. We ask whether an initial-value problem has a unique 
solution. Essentially this is two questions: 

1. Is there a solution to the problem? 
2. If there is a solution, is it the only one? 

As we see in the next two examples, the answer may be “no” to each ques- 
tion. 


| Example 6 | 2 An initial-value problem with no solution. 


The initial-value problem 
aa 
@ +y*+1=0 
dx 
with y(0) = 1 has no real-valued solutions, since the left-hand side is always 


positive for real-valued functions. = 


| Example 7 | An initial-value problem with more than one solution. 
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The initial-value problem 
dy _ 
dx 
with y(0) = 0 has at least two solutions in the interval —co < x < co. Note 
that the functions 


ay t/3 


a 


3v3 


both satisfy the initial condition and the differential equation. 


y=Oandy= 


Two Important Models 


One of the most fundamental models in biology deals with population growth 
and one of the most fundamental models in physics deals with a mass on 
a spring. In the next two examples, we examine how differential equations 
describe the behavior of these two phenomena. 


| Example 8 | ©) The change in the population of bacteria with sufficient nutri- 


ents and space to grow is known to be proportional to its current population. 
The differential equation can be written as 


dP 
—=kP 1.2 
dt ne) 
where P(t) is the current population of bacteria and k is a constant determined 
by its growth rate. We can verify that 


P(t) = P(0)e* (1.3) 


is a solution to this differential equation. Because of the presence of the con- 
stant P(0), we say that Equation (1.3) is a family of solutions parameterized 
by the constant P(0). To verify this is indeed a solution we take the derivative 
to get P(0)ke**. Subsituting this into the left side of the differential equation 
and the supposed solution into the right side: 


dP 
— =k. P 
dt ——— 
haa P(0)e** 
P(0)kekt 


we see that with a slight rearrangement of the expressions underneath, we have 
equality for all t. Thus (1.3) is a solution to differential equation (1.2) for all 
t and we see the solution describes the exponential growth of the population. 


|Example 9| In a later chapter we will learn that a mass on a spring moving 
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along a slippery? surface can be described by the differential equation 
ma” +kx =0 


where x(t) is the distance the spring has stretched from its resting length, k is 
the spring constant, and m is the mass, as shown in Figure 1.1. We can verify 


that x = cos ( / = t) is a solution. To do so we take the second derivative 


to get 2” = — - cos | / ~ t) and substitute it into the equation along with 
the assumed form of a: 


m: | Kom (ys) oreo ( (Ee) <0 
m m m 
——uxq~tqxr es 


" 
x - 


Simplification shows that it is indeed a solution and it holds for all t. 
x —- 


kK 


x=0 
(rest position) 


FIGURE 1.1: Model of spring system for Example 9. x = 0 marks the 
position if the spring were at its natural (unstretched) length and we will take 
x to the right as positive. 


In the next several sections we will develop methods for finding solutions to 
first-order differential equations. We will then discuss existence and unique- 
ness of solutions in Chapter 2. 


Problems 


In Problems 1-12, classify the differential equations by specifying (i) the or- 
der, (ii) whether it is linear or nonlinear, and (iii) whether it is an initial-value 
or boundary-value problem (where appropriate). 


?Physicists use the word “slippery” to mean “ignore frictional forces.” 
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1. 3y’+y=sinaz 2.y" =sinaz 

3.y' +y —y=0 4.y"+3y' =0, y(0)=1,y’/0) =0 
5. yO) + (sing)y®) +y=2, y(0) =1,y/(0) =0,y"(0) =2 

6.y”=0, y(1)=1,y/0) =2 7.y +e"y=y', y(0) =0 

8. y" —3yy' =a 9.y"+siny= 


10. y" — 4y'+4y=0, y(0)=1,y/(0) =1 
11. y" + ey’ +y? =0, y(0) =1,y(7) =0 
12. 27y"” + y' + (Inz)y =0 


In Problems 13-24, verify that the given function is a solution to the differ- 
ential equation by substituting it into the differential equation and showing 
that the equation holds true. Assume the interval is (—00, 00) unless other- 
wise stated. Do NOT attempt to solve the differential equation. 


d 
13.-y(2) = 22", a = 3y 14. y(z4)=2,y"+y=2 
x 
dy dy 
15.y=2, =~ =273(y—2) 16. — 9 SY _ 92/3 
5. y= 2, 7 oe ) 6. y(z) = 2°, T= dy 
17. y(a) = e* —a, atY =e 4 (1—-2Qe)e7 +27 -1 
x 
18. y(x) = sing +2cosa, y” +y=0 19. y(z) = 2? —271, 2?y" = Qy, « 40 
20. y(x) =x+Csing, y” +y = 2, C =constant 
—1 dy 2 -l_ dy 2 
21. = = a 22. —— —=5 —4/5 
ula) =z, He = 2, (00,3) 22. ula) = 17, = By, (4/5, 00) 
23. yi(x) = e® and yo(x) = ey (— 3y/ +2y=0 
24. yi(x) = e* and yo(x) = xe*, y" — 2y' +y =0 


In Problems 25-28, detetermine which of the functions solve the given differ- 
ential equation. 

25. y” +6y'+9y = 0: (a) e”, (b) e~3”, (c) xe~3*, (d) 4e37, (e) 2e-37 +2e— 3% 
26. y+ 9y = 0: (a) in 3a, (b )sinz, (c) cos (d) 2*,(e) 2 

27. y” — Ty’ +12y =0: (a) e?*, (b) e8”, (c) e4”, (d) e®*, (e) e8% + 2c 
28. y+ 4y’ + 5y = 0: (a) e~ 2", (b) e-2 gin 2x, (c) e~** cos2z, (d) cos2z 


In Problems 29-32, find values of r for which the given function solves the 
differential equation on (—oo, 00). 

29. y(z) =e", y+ 3y'+2y=0 30. y(r) = 
31. y(@) =axe™, y’ +6y'+9y=0 32. y(x) 


et, of + 3y' — dy = 0 
xe, y+ 4y' + 4y =0 


1.2 Separable Differential Equations 


We will now introduce the simplest first-order differential equations. Al- 
though these are the simplest class of differential equations we will encounter, 
they appear in numerous applications and aspects of subsequent theory. We 
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make the following definition: 


Definition 1.2.1 


A first-order differential equation that can be written in the form 


g(y)y’ = f(z) or gly) dy = f(x) dz, 


where y = y(), is called a separable differential equation. 


Separable differential equations are solved by collecting all the terms in- 
volving the dependent variable y on one side of the equation and all the terms 
involving the independent variable x on the other side. Once this is com- 
pleted (it may require some algebra), both sides of the resulting equations are 
integrated. That is, the equation 


can be written in “differential form” 


aly) = Fa) 


so that treating dy/dx as a fraction, we have 


g(y) dy = f(x) da. 


Here the variables are separated, so that integrating both sides gives 


[oway= f tear, (1.4) 


The Method of Separation of Variables, which we just applied to (1.4), is the 
name given to the method we use to solve Separable Equations—it is one 
of the simplest and most useful methods for solving differential equations. 
(Incidentally, it is an important technique for solving certain classes of partial 
differential equations, too.) 

Sometimes we will be able to solve (1.4) for y. When we can do so, we will 
say we can express the explicit solution and will write y = h(x). Other 
times, we will not be able to solve (1.4) or it will not be worth our time and 
efforts to do so. In these situations, we say that we are giving the implicit 
solution with (1.4). When our solution can be written explicitly, it will be 
easy to plot solutions in the xz-y plane, by hand or with the computer; how- 
ever, when the solution is implicit, plotting solutions by hand is challenging 
at best. The various computer programs, discussed in Appendix A and the 
end of each chapter, will allow us to view plots in the x-y plane without much 
additional work. We now consider a number of examples. 
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| Example 1| Solve y’ = ky where k is a constant. 


Solution 

Writing y’ as ay gives 
dy 
eae 
dx 


Treating “ as a “fraction” and rearranging terms gives 
dx 


d 
oF = kde. 
y 


This step will only be valid if y 4 0. We note that y = 0 is also a solution to 
the original differential equation. Integrating gives 


[te frac, 
y 


In|y| = ka + Cy,= > |y| = ehetor 


which is 


This gives 
eke (C1 ; 


beC1 


Now e@: is a positive constant, so that we may let C = 4 . In the above 
process, we encountered the constant solution y = 0, which also gives us the 
possibility that C = 0. Thus, we have 


v=Ce™ (1.5) 


as our solution, where x € (—oo, 00) and C is any real constant. We say that 
(1.5) defines a one-parameter family of solutions of y’ = ky. It is also 
important to remember the “trick” used above for getting rid of the absolute 
values—it will come up quite often in practice! We will consider a few more 


examples with similar standard “tricks.” = 


Solve a =e", 2f(0) =ln2, for xf). 


Solution 
Separating the variables gives 


and thus 
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Integrating both sides of this equation gives 
e"=e'+C. 
Solving for x, we have 
x =In|e’ +C|. 
Applying the initial condition «(0) = In2 yields 


In2=Inj1+C|, sothat C=1. 


Thus 
x =In(e’ + 1), 


which is defined for all t. Note that e’ + 1 is always positive so that we can 
drop the absolute value signs. We should also note that after integrating, we 
could have applied the initial condition to determine C and then proceeded to 
solve for x instead of first solving for x and then applying the initial condition 
to determine C. Both methods will result in the same final answer. See Figure 
1.2 for a plot of the solution. 


FIGURE 1.2: Plot of solution for Example 2. 


Solve (x — 4) y* — x? (y? — 3) =o 


Solution 
To separate variables, we divide by x°y*, which implicitly assumes that « 4 0 
and y £ 0. Doing so gives 


12. Chapter 1. Traditional First-Order Differential Equations 


as the general solution, which is valid when z £ 0 and y 4 0. This is definitely 
a case where giving the solution in an implicit representation is acceptable! 
See Figure 1.3 for a plot of the implicit solution. We refer the reader to the 
end of this chapter for the computer code used to plot these types of solutions 
with one of the software packages. There is, however, a more important idea 
that is illustrated by this example. If we assume x 4 0 and y? — 3 4 0, we 
can rewrite the original differential equation as 


dy _ (—4)y* 


dx -x3(y? — 3)’ 


and then one can clearly see that y = 0 is a solution. (That is, when y = 0 is 
substituted into both sides of the equation we get an identity for all a.) This 
problem shows that the separation process can lose solutions. 


Plot of Example 3 with C=-10,2,6,50 


= i f i a 


2 
2 1.5 =f 


FIGURE 1.3: Implicit plot for eee 3. The curves plotted here satisfy 
the implicit solution. We note here that the C-values superimposed on the 
curves were good for this problem, but it often takes ingenuity, experience, 
trial and error, or some combination of these to get a “nice” picture. 


How can we verify that 


is a solution? We need to substitute it into the differential equation as before. 
This will require us to find y’ and we will do so with implicit differentiation. 
Taking the derivative of both sides of the equation gives 


ae a oe 2 
van 
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We solve for x’ and then simplify the complex fraction to obtain 


y a (a 4) 


a8 (y? — 3)’ 


which is an equivalent form of our original differential equation. i? 


Although the separation process will work on any differential equation in 
the form of Definition 1.2.1, evaluating the integrals in (1.4) can sometimes be 
a daunting, if not impossible, task. As discussed in calculus, certain indefinite 


integrals such as 
/ e” dx 


cannot be expressed in finite terms using elementary functions. When such an 
integral is encountered while solving a differential equation, it is often helpful 
to use definite integration by assuming an initial condition y(aq) = yo. 


| Example 4 | ~ Solve the initial-value problem 


dy A» 
dn ey", y(2) 


and use the solution to give an approximate answer for y(3). 


Solution 

We would like to divide both sides by y? and we note that y = 0 is a solution. 
We set this solution aside and now assume y # 0, divide by y?, and integrate 
from x = 2 to x = 2 to obtain 


[wer Bae = -teaye 
te ee. 
y(zi) —-y(2) 


Z1 5 
= | e” dx. 
2 


If we let t be the variable of integration and replace 2; by x and y(2) by 1, 
then we can express the solution to the initial-value problem by 


1- e’ dt 
With an explicit solution, we often want 0 be able to find the corresponding 
y-value given any x. The right-hand side still cannot be solved exactly but 
can be approximated if x is given. For example, y(3) ~ —0.0007007. We note 
that we will have a point « > 2 that will make the denominator zero (and thus 
is not in the domain of our solution) and our function will become unbounded. 
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It is sometimes the case that a substitution or other “trick” will convert 
the given differential equation into a form that we can solve. A differential 
equation of the form 

dy 


4g =A (ax + by +k), 


where a,b, and k are constants, is separable if b = 0; however, if b 4 0 the 
substitution 
u(x) = ax + by +k 


makes it a separable equation. 


| Example 5 | Solve 


dy 2 
—= =f 
ae (ety ) 


by first making an appropriate substitution. 


Solution 
We let u = a+y-—4 and thus ou =u’. We need to calculate Pu For this 
example, taking the derivative with respect to x gives 


du dy 
—=|+—. 
dx = dx 


Substitution into the original differential equation gives 


This equation is separable. Dividing by 1 + u?, we obtain 


du 
1+ u? 


=dz 


and integrating gives 
arctan(u) = 2+ c¢. 


Thus u = tan(# +c). Since u= «+ y — 4, we then have 


y= —a2+4+tan(a+c), 


which is defined wherever tan(x + c) is defined. 


Problems 
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In Problems, 1-20, solve each of the following differential equations. Explic- 
itly solve for y(x) or x(t) when possible. 


1. ou = cos x 

2. 2 4u =(1+y) 

3.2% +t=1 

4. (l+2)% = 4y 

5. tana dy + 2ydz =0 
6. oy = 2,/ry 

7. dcydx + (x? +1)dy =0 
8. = 2 

‘dx ~ 1+4y? 

9.9 =10°"2 


1l.y'= xye® , y(0) = 1. Explain why this differential equation guarantees 
that its solution is symmetric about x = 0. 
12. y’ = 227(y? +1), y(0)=1 
13. (e*? +1) cosydy+e*(siny+1)dx=0, y(0)=3 
14. (tanz)y'’=y, y(5)=% 
15. 2x(y? + 1)dx+(a*+1)dy=0, y(1)= 
16. (x? — 1)y' + 2xy” = 0, y(V3) =1 
Violet 2yee ae +a) dg, y(—3) =-1 
18. 8 cos? y da +csc? xdy=0, y(a/12) = 7/4 
19. y’=e" , y(0)=0 
dy y?+2y 
- de £24382’ ait 


21. Find the solution of the following equation that satisfies the given condi- 
tions for z+ +00: xy’ — cos2y=1, y(+oo) = %. 

22. Find the solution of the following equation that satisfies the given condi- 
tions for x 4 +00: 3y?y’ + 162 = 2ry?, y(x) is bounded for 2 + +00. 


In Problems 23-27 make an appropriate substitution to solve each of the fol- 
lowing differential equations. Explicitly solve for y(a) or x(t) when possible. 


23. cydx + (1+ 1)dy =0 24.4’ —y=2x-3 
25. (w+ 2y)y’ =1 y(0) = —-2 26. y’ = cos(y — x) 
27. y' = /4a 4+ 2y—1 


28. Suppose that the population N(t) of a given species (bacteria, elves, 
Toolie birds, college students, etc.) is not always zero and varies at a 
rate proportional to its current value. That is, 


where r € R is some measured constant proportionality factor. If the 
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initial population is assumed to be N(0) = No > 0, solve this exponential 
differential equation and discuss the behavior of the solution as t + oo 
for different values of r. 


29. An equivalent way of thinking of the exponential growth problem 28 is to 

assume the per capita growth rate, x a is constant. That is, we assume 
= <=" =r. It is more realistic to assume that the per capita growth rate 
decreases as the population grows. If we assume this decrease is linear 
and agrees with the exponential growth model for small populations, we 


can write the equation 


where the left-hand side is the per capita growth rate and the right-hand 
side is a linearly decreasing function in N that has y-intercept r and 
x-intercept K. Multiplying both sides by N gives 


which is the well-known logistic differential equation. If the initial pop- 
ulation is given as N(0) = No > 0, solve this differential equation and 
discuss the behavior of the solution as t + oo. From this behavior, why 
is Kk called a carrying capacity? 


1.3 Linear Equations 


Linear first-order differential equations are perhaps the most commonly aris- 
ing class of differential equations in applications. A linear differential equation 
is defined as follows: 


Definition 1.3.1 
A first-order ordinary differential equation is linear in the dependent 
variable y and the independent variable x if it can be written as 


dy 


ar + P(x)y = Q(z). (1.6) 


More generally, we often see equations of the form 


ai(a)y! + ao(x)y = b(@) 
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but, provided a,(x) 4 0 for all 2, we can always divide by ai(a) and define 
P(x) = ao/a, and Q(x) = b/a, to obtain an equation of the form of (1.6). 

In our work to follow, specifically in Chapters 3 and 4 we will refer to an 
equation of this form as a “linear nonhomogeneous equation.” In the case 
when Q(x) = 0, we refer to the equation as “homogeneous,” but we caution 
the reader to be careful with the word “homogeneous” as it can also have other 
meanings; see Section 1.6. While it is an unfortunate fact that mathematicians 
often use the same term for different mathematical notions, our use of it should 
be clear by context. 

In the following pages, we present two techniques for solving linear differ- 
ential equations. It is likely the case that only one of these methods will be 
presented in class depending on the emphasis of your course. The first is 
variation of parameters while the second is the integrating factor technique. 


Variation of Parameters 


The first method of solving linear equations that we consider has a nice gen- 
eralization for higher order equations. If we consider (1.6) with Q(a) = 0: 


we can solve this linear homogeneous equation by using separation of vari- 
ables. We obtain y,, the complementary solution.*? We know that we can 
multiply y. by any constant and it will still be a solution; however, we instead 
consider uy. where u is a function of x and try to find a function u that will 
make this work. In order for u(a)y. to be a solution, it needs to satisfy the 
differential equation. Substituting the assumed solution into (1.6) we obtain 


(ul(a)ye + u(x)ye') + P(x)u(x)ye = Q(x), (1.7) 
which we can regroup and then simplify: 


ul (aye + u(a)[ye! + P(x) ye] = Q(x) 
<<, J 


_ 


since y- is a solution to the homogeneous equation. We then solve for u’ (zx) 
and integrate to obtain: 
x 
u(x) = a) 5. (1.8) 
Yc 


As we only care about finding one function u(«) that will work, we don’t 
introduce the typical +C upon integration. Thus we have found a function 


3This solution is sometimes called the homogeneous solution and is denoted y,. The 
terms are used interchangeably. 
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u(az) that makes wy. a solution—we call this a particular solution and denote 
it yp. Our general solution to (1.6), with y, = u(x)yc, is then 


y= CYc + Up, (1.9) 


where C is a constant that is determined by the initial condition. 


| Example 1 | Solve 7 + 2xy = 3x using variation of parameters. 
x 


Solution 
This equation is linear with P(«) = 2x and Q(x) = 3x. We solve the homo- 
geneous equation first: 


d d 
= —2ay> [Y= f 200s 
dx y 


=> In|y| = —2?+C, 
=>y=Ce. (1.10) 
We now assume that a particular solution can be written as 


—g? 


Yp = U(X)Ye = u(a)e 


The function u(a) that will allow this to be a solution of the original linear 
equation is 


u(a) = Ge) 5, 


Ye 


= | Saar 
e 
2 


= 2%", (1.11) 
Recalling that y, = u(x)yc, our solution is then given by 


y = Cyc + Yp 
=Ce™ + 3 07 2" (1.12) 


which simplifies to 


We can easily check that this is a solution of the original differential equation. 
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using variation of parameters. 


Solution 
This is clearly linear and we first solve the homogeneous equation 


d 2 1 
a+ ( e+ Ju=o 
dx x 


Separation of variables gives us 


We now assume a particular solution of the form y, = u(x) —. From the 


derivation, we know that things will cancel out so that we need to solve for u 


in (1.8): 
( / e72t / j 
u(x) = | ——— = | «dx 
ely 
so that 
2 2 22x 
re i ee 
ule) = > yp = uly = = 520 
Our general solution is ye + Yp: 
Cc 1 
y= eo 2e As ~ e722 
x 2 


Superposition 
A key idea in the study of linear differential equations is that of superposi- 
tion. We have been studying the basic linear equation (1.6) 


We can state a very useful theorem that will serve as an important tool in our 
further study. 
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THEOREM 1.3.1 Superposition 
Suppose that y; is a solution to y’ + P(x)y = Qi(x) and yp is a solution 
to y’ + P(x)y = Qa(x). Then 


Cy isasolutionto y+ P(x)y = Qi (2) 
for any constant c,. For any constants c,,c2, we also have that 


c1y1 + coye is a solution to y + P(x)y = 1Qi(x) + c2Qa(zx). 


| Example 3 | Verify that e?* is a solution to = + y = 3e”" and 52 —5isa 
XL 


d 
solution to A +y = 5a. Then find a solution to 
x 


d 
OF ty =e 4 de, 
dx 


Solution 
We can easily verify that y,; = e?” and yo = 52 — 5 are the solutions of 
the respective differential equations. Let Qi(a) = 3e7", Qo(x) = 5a, and 
Q(x) = e?* +4x denote the right-hand sides of the three differential equations. 
We observe that 1 4 

Q(2) = 5@r(2) + 5Q2(2). 
By superposition, it follows that 

t .4. dpa A 

y= gut pie = gle ) + <(5a — 5) 


is a solution of y’ + y = Q(2). ia 


Integrating Factor Technique 

In studying separable equations, we put all the terms of one variable on the 
left side of the equation and the terms of the other variable on the right side 
of the equation. This allowed us to integrate functions of just one variable. 
Another trick that we will use is to rewrite the left side so that it looks like 
the result of the product rule (from Calculus). To remind ourselves, for y, wu 
that are both functions of the same variable, the product rule states that 


(yp) =y'w+ py. 


We know how to integrate the left hand side so the goal is to somehow rewrite 
part of our equation so that it looks like the right-hand side. Looking at 
y+ p’y and recalling our basic linear equation y’ + Py = Q, we want to 
multiply the left-hand side by a function yz that satisfies 


je = pP. (1.13) 
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In this equation, P = P(x) is known, whereas yp = (a) (called the inte- 
grating factor) is unknown. We can find ju(%) because Equation (1.13) is 
separable. Thus 


d 
CF = P(x) dx 
bb 
Integrating gives 
pola) = ef Ple)de (1.14) 


Since (1.14) is an integrating factor, we have 


d ») de 
ef P(a)dx ay 4 el P(x)dz P(z)y = Q(a)e! Pee 


—— dz ————$ 
Ll Se , 


which is the same as 


So 
es PUR) AS _ feel @tac + co 


which gives 
y =e J P(e) de (/ Q(x)el P@4 dg + c) (1.15) 


as the solution of the differential equation (1.6). Note that we have explicitly 
written the constant of integration even though the integral has not yet been 
evaluated. Depending upon your situation, one can memorize the formula 
(1.15) for the solution of a first-order linear equation; however, it is just as 
easy (if not out right preferable) to simply apply the method of solution each 
time. 


Summary: Solving linear equations via an integrating factor 
1. Write the linear equation in the form of Equation (1.6). 

2. Calculate the integrating factor ef P(*) 4, 

3. Evaluate the integral [ Q(x)e/ ?“4*dzx and then multiply this result 
by e J P@) dx 

4. The general solution to (1.6) is 


y= Ce7 J P(@) dx A. eS Pa f O(aiel Peds de. 
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In the event that we are given an initial condition y(ao) = yo, we would 
apply it at the time of integration, going from po to a final (general) value z. 
If we let p(x) = f P(x)dz, then the general formula becomes 


y = Ce-Pl®) + e- Pte) il Q(ax)e") der, 
and applying the initial condition gives us the solution 
y = yo 0)-P@) 4 ¢-B(2) Q(t) at, (1.16) 
Bae) 


where the variable of integration has changed to a dummy variable t. 


This is linear with 


— 2a+1 


P(x) and Q(z)=e * 


so that an integrating factor is 
es P(a)dx = al a 


= e(2e+In |x|) 


a |a|e?”. 


We note that integrating factors are not unique. For instance, dropping the 
absolute value to obtain xe?” gives another integrating factor of the differential 
equation. Thus, multiplying the original equation by this expression gives 
d 
vere Y 4 e** (22 + 1)y = 2. 
dx 


If we had multiplied by —xe?”, we would have obtained the same equation. 
This equation can be simplified to give 


Integrating this equation gives 


1 
rey = st +C, 
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which becomes 1 C 
p= ge 4 ee, 
2 x 


These last few steps could have been avoided by using (1.15). 


Solve (22+ ys +4y = x with the initial condition y(0) = 10. 
6; 


Solution 
Rewriting this equation gives 


dy Aa x 
ae a ee 
dz z2+1 x2+1 


hence 


so that an integrating factor is 


4x 
et P(x)dx = af e241 da: 
= eln(2?-+1)? 


= (x? +1). 


Once we have our integrating factor, we can use the solution as given in (1.15), 
first noting that 


e— J P(a)dx = 2- In(a?+1)? 


(a? +1)7?. (1.17) 


Then 


1 ire ae 
~ (a2 + 1)? (F# ge +e), 


Now the initial condition, y(0) = 10, gives C = 10 and thus 


gut + 5a? +10 
Yy no 
(x? + 1)2 


is the solution we seek. 
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Now that we know the techniques of solving linear equations, we consider 
some applications. In Section 1.4, we will consider Newton’s law of cooling 
that describes how the temperature of an object changes due to the constant 
temperature of the medium surrounding it. This is not always realistic, as 
in some settings the temperature of the surroundings varies. For example, 
determining the temperature inside a building over a span of a 24-hour day 
is complicated because the outside temperature varies. If we assume that 
the building has no heating or air conditioning, the differential equation that 
needs to be solved to find the temperature u(t) at time t inside the building 
is d 

7 = k(C(t) — u(t), (1.18) 
where C(t) is a function that describes the outside temperature and k > 0 is 
a constant that depends on the insulation of the building. Note that (1.18) is 
a linear equation. According to this equation, if C(t) > u(t), then 


du 
dt 
which implies that u(t) increases, and if C(t) < u(t), then 
du 
dt 


> 0, 


<0, 


so that u(t) decreases. 


| Example 6| Suppose that on a given day during the month of April in 


Pomona, California, the outside temperature in degrees Fahrenheit is given 
by 


tt 
C(t) = 70 — 10 — 
(t) cos ( i 5) 
for 0 < t < 24. Determine the temperature in a building that has an initial 
temperature of 60°F if k = 1/4. See Figure 1.4. 


Solution 
We see that the average temperature (i.e., the average of C(t)) is 70°F because 


24 
tt 
— }|dt=O0. 
[ «(%) 0 


The initial-value problem that we must solve is 


du at 
Wo k (70- 10. cos (5) -u) 


with initial condition u(0) = 60. The differential equation can be rewritten as 


du mt 
—+ku=k -1 — 
di + ku (7 ocos (5). 
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Outside 
Temperature 
(in °F) 


time (in hours) 


0 5 10 15 20 


FIGURE 1.4: Outside temperature over 24 hours for Example 6. 


which is a linear equation and is thus solvable. This gives (check it!) 


10 t t 
ut) = so (ss +7? —9cos (5) — 3rsin (5)) ae 


We then apply the initial condition u(0) = 60 to determine the arbitrary 
constant C; and obtain the solution 


m t t 10m? 
u(t) = Gang (0s + 7x? — 9cos (5) — 37sin (3) — — en t/4, 


A graph of this solution is shown in Figure 1.5. The graph shows that the 
temperature reaches its maximum of about 77°F near t = 15.5, which is about 
3:30 p.m. 


804 
Inside 
Temperature 75 | 


(in °F) 


704 


654 


eo time (in hours) 
oO 5 10 15 20 


FIGURE 1.5: Inside temperature over 24 hours for Example 6. 
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Sometimes an equation may not immediately appear to be linear. 


| Example 7 | Consider the differential equation 


y” dx + (3ay — 1) dy = 0. 


This equation is not linear in y. What do we do? Look harder. If we consider 
y as the independent variable and x as the dependent variable, we can write 


dx _ 1—3ry 
dy yr? 
which is 
de 3e_ 1 
dy yy?’ 
and we see that it is in the form 
dx 
“4 ?p = 
ra (y)z = Q(y), 


which is linear in x, so that this equation can be solved using the theory we 
have just developed. 
Hence, an integrating factor is 
ef P)dy — oS Fay — lnlyl? — y. 


We also have exp (— f P(y)dy) = 1/y*. Then our solution is 


1 it 3 C 
oma (f pura) +i 

1 2 C 

y \2 y 
This becomes 

1 
0 Qy + ys 

which is defined for all y 4 0. ‘a 
e e e e e e e e e e e e 


Problems 
Solve the linear equations in Problems 1-18 by considering y as a function of 
x, that is, y = y(a). 
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l.y’+y=e 2.y/+2y=4 ; 
3. y/ + 2y = —32 4. y' — 2xy = e* 
5. y! — 3a7y = 2x? 6. 3ry' +y = 122 
dy 1 | 
ye Sie 8.y'+-y=e? 
i de xt x y+ oy e 
9. is fat) =x 10. vy’ + (1+2)y=e-* sin 2a 
11. = +y = cose 12. (2a + 1)y’ = 4a + 2y 
x 
d 
13. % —y =4e", y(0) =4 14. y' + 2y =xe-27, y(1)= 
c 


15. y'+ytanz=secar, y(7) =1 16.7’ =(1—y)cosaz, y(m) = 
17. ay +2 = S82 y(F)= 4,¢2>0 18. cy’+2y =sing, y(3)=1,2>0 


7? 


Solve the linear equations in Problems 19-21 by considering x as a function 
of y, that is, v = a(y). 

19. (x + y?)dy = ydx 20. (2e% — x)y’ =1 

21. (sin2y+acoty)y’ =1 


Problems 22-23 address aspects of superposition. 


22. Recall that a linear equation is called homogeneous if Q(x) = 0, ie., if 

it can be written as 

ay + P(x)y=0. 

dx 
(a) Show that y = 0 is a solution (called the trivial solution). 
(b) Show that if y = y,(2) is a solution and k is a constant, then y = 
ky,(a) is also a solution. 
(c) Show that if y = yi(x) and y = yo(z) are solutions, then y = yi(x) + 
y2(a) is a solution. 


d 
23. (a) If y = y1(2) satisfies the homogeneous linear equation 7 +P(x)y= 


d 
0 and y = yo(a) satisfies the nonhomogeneous linear equation =; + 
Ho 


P(x)y = r(x), show that y = yi(x) + ye(x) is a solution to the non- 
homogeneous linear equation 


d 
(b) Show that if y = yi(x) is a solution of ; + P(x)y = r(x), and 


d 
Y = Y2(x) is a solution of os + P(x)y = q(x), then y = y1 (a) + yo(x) is 
v 
a solution of 


28 


24. 


25. 


26. 
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(c) Use the results obtained in parts (a) and (b) to solve 
—+2y=e *+ cosa. 


A pond that initially contains 500,000 gal of unpolluted water has an 
outlet that releases 10,000 gal of water per day. A stream flows into the 
pond at 12,000 gal/day containing water with a concentration of 2 g/gal 
of a pollutant. Find a differential equation that models this process and 
determine what the concentration of pollutant will be after 10 days. 


When wading in a river or stream, you may notice that microorganisms 
like algae are frequently found on rocks. Similarly, if you have a swim- 
ming pool, you may notice that in the absence of maintaining appropriate 
levels of chlorine and algaecides, small patches of algae take over the pool 
surface, sometimes overnight. Underwater surfaces are attractive envi- 
ronments for microorganisms because water removes waste and provides 
a continuous supply of nutrients. On the other hand, the organisms must 
spread over the surface without being washed away. If conditions become 
unfavorable, they must be able to free themselves from the surface and 
recolonize on a new surface. 


The rate at which cells accumulate on a surface is proportional to the 
rate of growth of the cells and the rate at which the cells attach to the 
surface. An equation describing this situation is given by 


dN(t) 


ra r(N(t) + A), 


where N(t) represents the cell density, r the growth rate, A the attach- 
ment rate, and t time. 
(a) If the attachment rate, A, is constant, solve 


vo = r(N(t) + A) 

with the initial condition N(0) = 0. 

(b) If A = 3 in a particular colony of cells, use the following table to 
t 1)2) 3] 4 

N(t) | 3} 9] 21) 45 

Using this growth rate, estimate the algae population size at the end of 

24 hours and 36 hours. 


find the growth rate at the end of each hour: 


In Section 3.7, you will learn about electric circuits as an application of a 
second order differential equation. However, consider the circuit with an 
inductor and resistor only, whose differential equation is first-order and 
linear and is given by 

LI'+RI=V, 
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where I is the to-be-determined current in the circuit, Z measures the 
inductance, R measures the resistance, and V is the constant applied 
voltage. Find an equation describing the current in the circuit. 

27. Suppose a(t) > 0, and f(t) > 0 for t + oo. Show that every solution of 
the equation 


approaches 0 for t + oo. 

28. In the same equation suppose that a(t) > 0, and let w(t) be the solution 
for which the initial condition x(0) = 0 is satisfied. Show that for every 
positive « > 0 there is a 6 > 0, such that if we perturb the function f(t) 
and the number b by a quantity less than 6, then the solution a(t),t > 0, 
is perturbed by less than ¢. The word perturbed is understood in the 
following sense: f(t) is replaced by fi(t) and 6 is replaced by 6b; where 


lft) - FO <e, |br—b] <4. 


This property of the solution x(t) is called stability for persistent dis- 
turbances. 


1.4 Some Physical Models Arising as Separable Equa- 
tions 


Now that we have studied separable equations in detail, we consider some 
applications. The wide variety of application problems that we will consider 
all lead to equations in which variables can be separated. 


Free Fall, Neglecting Air Resistance 


We will begin this application section with an easy problem from elementary 
physics. This application should be very familiar. 

If x(t) represents the position of a particle at time t, then the velocity of 
the particle is given by 


dv d?x 
dt dt?” 
Thus, if we consider a particle that is in free fall, where the acceleration of 
the particle is due to gravity alone, we have 


a(t) = —g. 
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Here g is assumed to be a constant and we use —g as gravity acts downward. 
For the moment, we ignore the effects of air resistance. Thus, 


dv 
dt 
which is a simple separable equation, so that 
u(t) = —gt+e. 
If we assume that the particle has an initial velocity vo, so that v(0) = vo, 
then u(t) = —gt + vp. Now this gives the separable equation 


dx 
ae ee 
which has solution 
a(t) = 2? + vot + Ch. 


If the particle has initial position xo, then 


x(0) = 29 
which gives 
x(t) = St + vot + 20 (1.19) 


as the position x(t) of the particle in free fall, at time t. 


/Example 1, A man standing on a cliff 60 m high hurls a stone upward at a 


rate of 20 m/sec. How long does the stone remain in the air and with what 
speed does it hit the ground below the cliff? 


Solution 
Here 29 = 60 and vp = 20. We take g = 9.8 m/sec”. Thus, 
9.8 
a(t) = as + 20¢ + 60 
and 


v(t) = —9.8t + 20. 


The stone is in the air while x(t) > 0, so to find the time ¢ that the stone is 
in the air, we set z(t) = 0 and solve for t. Using the quadratic equation, 


, = 220+ ,/ (20)? — 4(—4.9) (60) 
7 2(—4.9) 


The stone is thus in the air for about 6.1 sec. We use this time to find the 
velocity upon impact: 


v(6.1) = —9.8(6.1) + 20 = —39.78 m/sec. 


=—2.01, 6.09. 
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Air Resistance 

We will now consider the effects of air resistance. The amount of air 
resistance (sometimes called the drag force) depends upon the size and ve- 
locity of the object, but there is no general law expressing this dependence. 
Experimental evidence shows that at very low velocities for small objects it is 
best to approximate the resistance R as proportional to the velocity, while for 
larger objects and higher velocities it is better to consider it as proportional 
to the square of the velocity [38). 

By Newton’s second law F' = ma, so that if v(t) is the velocity of the object, 
we have 


where F‘ is the weight of the object, 
Fi = mq, 
and F% is the force of the air resistance on the object as it falls, so 
Fy =kyv or Fy = kv? 


where k,,k2 are proportionality constants. Note that k; < 0 because air 
resistance is always opposite the velocity; see examples 2 and 3 below. We 
also point out that the units of k, and ko are different. In SI units, force has 
units of Newtons = N = kg: m/sec?. Thus k; must have the units of kg/sec. 
On the other hand, k2 can be written as 


1 


where p is the air density (SI units of kg/m), A is the cross-sectional area of 
the object (SI units of m?), and C is the drag coefficient (unitless) {38}. 


| Example 2 An object weighing 8 pounds falls from rest toward earth from 


a great height. Assume that air resistance acts on it with a force equal to 2v. 
Calculate the velocity v(t) and position #(t) at any time. Find and interpret 
limy +0 v(t). 


Solution 

Remembering that pounds is a force (not a mass), we see that we need to 
calculate the mass of the object in order to apply Newton’s second law. Using 
g = 32 ft/sec? gives m = w/g = 8/32 = 1/4. Thus by Newton’s second law 


that is 
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This is a separable equation and can be written as 


dv 
8 — 2v 


= 4dt 
so that upon integrating both sides we have 
1 
—5 nls — 2v| = 4t+e. 
Using the condition that the object fell from rest, so that v(0) = 0, we can 
determine the constant c and solve for u(t). We have 
v(t) =4—4e* 


as the velocity of the object at any time. A graph of this velocity is shown in 
Figure 1.6. Analytically, we see that u(t) approaches 4 as t + oo. This value 
is known as the limiting or terminal velocity of the object. 


Now since ee = v(t), we have 


This is easily integrated to obtain x(t) = 4t+ ze *t +c. If we take the initial 
position of the object as zero, so that «(0) = 0, then 


1 1 
h=46+ 26" — =, 
x(t) ar 5 


velocity 


) 0.1 0.2 0.3 0.4 0.5 
time 


FIGURE 1.6: Approach to terminal velocity of free-falling object of Ex- 
ample 2. 
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A Cool Problem 
In addition to free-fall problems, separable equations arise in some simple 
thermodynamics applications. One such application is the following example. 


Suppose that a pie is removed from a hot oven and placed in a cool room. 
After a given period of time the pie has a temperature of 150° F. We want to 
determine the time required to cool the pie to a temperature of 80°F, when we 
can finally enjoy eating it. 


This example is an application of Newton’s law of cooling, which states 


the rate at which the temperature T(t) changes in a cooling body is 
proportional to the difference between the temperature of the body 
and the constant temperature T, of the surrounding medium. 


Symbolically we know the rate of change is the derivative and the statement 
is expressed as 


—— =k(T —T,), (1.20) 


with the initial temperature of the body T(0) = To and & a constant of 
proportionality. We observe that if the initial temperature 7p is larger than 
the temperature of the surrounding T,, then T(t) will be a decreasing function 
of t (as the body is cooling), so dT/dt < 0, but To — T; > 0 so that the 
proportionality constant / must be negative. A similar analysis with Ty < 
T, also gives k < 0. This condition on k also follows by noting that the 
temperature of the body will approach that of the surrounding medium as 
time gets large. 

To solve (1.20), we seek a function T(t) that describes the temperature at 
time t. For this equation, separating the variables we have 


dT 
fee ie 


= kdt. 


Integrating both sides of this equation gives 


dT 
ff alia 


Evaluating both integrals, we obtain 


In|T —T,| =kt+C, 


where C' is the constant of integration. Exponentiating both sides and sim- 
plifying gives 
|\T —T,| = eeS —> T-T, = +e%e™. 
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Solving for the temperature, we see that 


T(t) =Cre™ +T, 


where C, = +e°. We can then apply the initial condition T(0) = Tp, which 
implies To = C, + T,, so that Cy = Tp — T, and the solution is then 


TG) =(Ip= Te" +Ts. (1.21) 


We know that the temperature of the body approaches that of its surround- 
ings and this can be seen mathematically as 


oe DN) = Tas 


which is true because k < 0. 
Let’s now consider a specific pie-cooling example. 


/Example 3 | Suppose that a pie is removed from a 350°F oven and placed 


in a room with a temperature of 75°F. In 15 min the pie has a temperature 
of 150°F. We want to determine the time required to cool the pie to a tem- 
perature of 80°F, when we can finally enjoy eating it. 


Solution 
Comparing with the above derivation, we see that Tg = 350 and T, = 75. 
Substituting these values in (1.21) gives 


T(t) = 275e* + 75. 


We still need to find k or equivalently e*, which quantifies how fast the cooling 
of the pie occurs. We were given the temperature after 15 min, ie., T(15) = 
150. Thus 

275e5* 4.75 = 150, 


and solving for e* gives 


or k = —0.08662. Thus 
3 \ t/15 
T(t) = 275 (=) +75, 


and this can be used to find the temperature of the pie at any given time. 
We can also calculate the time it takes to cool to any given temperature. We 
want to know when T(t) = 80°F. Thus we solve 
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for t to obtain 
—151n55 


~ In3—Inll 


Thus, the pie will reach a temperature of 80°F after approximately 46 min. 
It is interesting to note that the first term in our equation for the pie 


temperature satisfies 
3 \t/15 
275 (=) >0 


~ 46.264. 


for all t > 0. Thus 


3 


£/15 
— 75 > 75. 
=) +75 > 


T(t) = 275 ( 


The pie never actually reaches room temperature! This is an artifact of our 
model; we do note, however, that 


t/15 
lim 275 (=) +75 = 75, 
too jul 


which can also be seen in Figure 1.7. 


time (in min) 


FIGURE 1.7: Graph of pie temperature vs. time of Example 3. 


We present another example of Newton’s law of cooling from forensic sci- 
ence. 


OV" In the investigation of a homicide, the time of death is impor- 
tant. The normal body temperature of most healthy people is 98.6°F. Suppose 
that when a body is discovered at noon, its temperature is 82°F. Two hours 
later it is 72°F. If the temperature of the surroundings is 65°F, what was the 
approximate time of death? 
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Solution 
This problem is solved as the last example. Here T(0) represents the temper- 
ature when the body was discovered and T(2) is the temperature of the body 
2 hours later. 

Thus, To = 82 and T, = 65 so that (1.21) becomes 


T(t) = 17e™" +65. 


Using T(2) = 72, we solve 17e?* + 65 = 72 for e* to find 


so that 
7\t/2 
TH = 17 | 65. 
(i) (5) + 


This equation gives us the temperature of the body at any given time. To find 
the time of death, we use the fact that the body temperature was at 98.6°F 
at this time. Thus we solve 


7\t/2 
17 (=) + 65 = 98.6 


for t and find that 2 n(1.97647) 
n(1. 
aa OGL 1.53569. 


This means that the time of death occurred approximately 1.53 hours be- 
fore being discovered. Therefore, the time of death was approximately 10:30 
a.m. because the body was found at noon. 


Mixture Problems 
Problems involving mixing typically give rise to separable differential equa- 
tions. A typical mixture problem is given in the following example. 


|Example 5 | A bucket contains 10 L of water and to it is being added a salt 


solution that contains 0.3 kg of salt per liter. This salt solution is being poured 
in at the rate of 2 L/min. The solution is being thoroughly mixed and drained 
off. The mixture is drained off at the same rate so that the bucket contains 
10 L at all times. How much salt is in the bucket after 5 min? 


Solution 

Let y(t) be the number of kilograms of salt in the bucket at the end of t 
minutes. We need to derive a differential equation for this problem and we do 
so by considering change in this system over a small time interval. We first 
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find the amount of salt added to the bucket between time ¢ and time t + At. 
Each minute, 2 L of solution is added so that in At minutes, 2At liters is 
added. 

In these 2At liters the amount of salt is 


0.3 kg/L x (2At) L = (0.6At) kg. 


On the other hand, 2At¢ liters of solution is withdrawn from the bucket in an 
interval At. Now at time t the 10 L in the flask contains y(t) kilograms of 
salt. Then 2A¢ of these liters contains approximately (0.2At)(y(t)) kilograms 
of salt if we suppose that the change in the amount of salt y(t) is small in the 
short period of time At. 

We have computed the amount of salt added in the interval (t,t + At), 
as well as the amount subtracted in the same interval. But the difference 
between the amounts of salt present at times t+ At and t is y(t + At) — y(#), 
so that we have obtained the equation 


y(t + At) — y(t) = 0.6At — (0.2At)(y(t)). 


We now divide by At and let At + 0. The left side approaches the derivative 
y(t), and the right side is 0.6 — 0.2y(t). The differential equation is thus 


y'(t) = 0.6 — 0.2y(t), (1.22) 


which can be thought of as the rate of change in the number of kilograms of 
salt in the bucket y'(t) being equal to the rate of salt (in kg) flowing into the 
bucket 0.6 (= 0.3 kg/L x 2 L) minus the rate of salt flowing out of the bucket 
0.2y(t). 

Equation (1.22) is a separable equation and can be written as 


Integrating both sides gives 
In |0.6 — 0.2y| = —0.2t + ¢ 
so that solving for y(t) we obtain 


y(t) =3=Ce °**, (1.23) 


When ¢ is zero, the amount of salt in the bucket is zero, that is, y(0) = 0. 
Equation (1.23) shows that when t = 0, we have 


y(0) =3—C; 
or C = 3. The value of C is now known, so that Equation (1.23) becomes 


y(t) = 3 —3e- 9, 
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To find y at the end of 5 min, we simply substitute t = 5 so that the amount 


of salt in the bucket is y(5) + 1.9 kg. - 


Problems 


In Problems 1~—7 it will be convenient to take the velocity to be the unknown 
function. 


1. A ball dropped from a building falls for 4.00 sec before it hits the ground. 
If air resistance is neglected, answer the following questions: 
(a) What was its final velocity just as it hit the ground? 
(b) What was the average velocity during the fall? 
(c) How high was the building? 

2. You drop a rock from a cliff, and 5.00 sec later you see it hit the ground. 
Neglecting air resistance, how high is the cliff? 

3. A ball thrown straight up climbs for 3.0 sec before falling. Neglecting air 
resistance, with what velocity was the ball thrown? 


4. Iron Man is flying at treetop level near Paris when he sees the Eiffel 
Tower elevator start to fall (the cable snapped). He knows Pepper Potts 
is inside. If Iron Man is 2 km away from the tower, and the elevator 
falls from a height of 350 m, how long does he have to save Pepper, 
and what must be his average velocity? Solve this problem assuming 
no air resistance. (Of course, Tony Stark instantly does the calculations 
required, as he is an expert in differential equations!) 

5. The mass of a football is 0.4 kg. Air resists passage of the ball, the 
resistive force being proportional to the square of the velocity, and being 
equal to 0.004 N when the velocity is 1 m/sec. Find the height to which 
the ball will rise, and the time to reach that height if it is thrown upward 
with a velocity of 20 m/sec. How is the answer altered if air resistance is 
neglected? 

6. The football of the preceding exercise is released (from rest) at an altitude 
of 17.1 m. Find its final velocity and time of fall. 

7. Assume that air resistance is proportional to the square of velocity. The 
terminal velocity of a 75-kg human in air of standard density is 60 m/sec 
[38]. Neglecting the variation of air density with altitude and assum- 
ing that the 75-kg parachutist falls from an altitude of 1.8 km, find the 
velocity. Hint: use the terminal velocity to find the coefficient of v?. 


Problems 8-12 concern Newton’s law of cooling. 


8. At the request of their children, Randy and Stephen make homemade 
popsicles. At 2:00 p.m., Kaelin asks if the popsicles are frozen (0°C), at 
which time they test the temperature of a popsicle and find it to be 5°C. If 


10. 


11. 


12. 
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they put the popsicles with a temperature of 15°C in the freezer at 12:00 
noon and the temperature of the freezer is —2°C, when will Erin, Kaelin, 
Robyn, Ryley, Alan, Abdi, and Avani be able to enjoy the popsicles? 


. An object cools in 10 min from 100°C to 60°C. The surroundings are at 


a temperature of 20°C. When will the object cool to 25°C? 


Determine the time of death if a corpse is 79°F when discovered at 3:00 
p-m. and 68°F 3 hours later. Assume that the temperature of the sur- 
roundings is 60°F and that normal body temperature is 98.6°F. 


A thermometer is taken from an inside room to the outside, where the 
air temperature is 5°F. After 1 minute the thermometer reads 55°F’, and 
after 5 minutes it reads 30°F. Determine the initial temperature of the 
inside room. 

A slug of metal at a temperature of 800°F is put in an oven, the temper- 
ature of which is gradually increased during an hour from a®° to b°. Find 
the temperature of the metal at the end of an hour, assuming that the 
metal warms kT degrees per minute when it finds itself in an oven that 
is T degrees warmer. 


In Problems 13-17 it is supposed that the amount of gas (or liquid) contained 
in any fixed volume is constant. Also, thorough mixing is assumed. 


13. 


14. 


15. 


16. 


A 20-L vessel contains air (assumed to be 80% nitrogen and 20% oxygen). 
Suppose 0.1 L of nitrogen is added to the container per second. If con- 
tinual mixing takes place and material is withdrawn at the rate at which 
it is added, how long will it be before the container holds 99% nitrogen? 


A 100-L beaker contains 10 kg of salt. Water is added at the constant 
rate of 5 L/min with complete mixing, and drawn off at the same rate. 
How much salt is in the beaker after 1 hour? 


A tank contains 25 lb of salt dissolved in 50 gal of water. Brine containing 
4 lb/gal is allowed to enter at a rate of 2 gal/min. If the solution is drained 
at the same rate find the amount of salt as a function S(t) of time ¢t. Find 
the concentration of salt at time. Suppose the rate of draining is modified 
to be 3 gal/min. Find the amount of salt and the concentration at time 
be 


Consider a pond that has an initial volume of 10,000 m?. Suppose that 
at time t = 0, the water in the pond is clean and that the pond has 
two streams flowing into it, stream A and stream B, and one stream 
flowing out, stream C. Suppose 500 m3/day of water flows into the pond 
from stream A, 750 m°/day flows into the pond from stream B, and 1250 
m® flows out of the pond via stream C. At t = 0, the water flowing 
into the pond from stream A becomes contaminated with road salt at a 
concentration of 5 kg/1000 m?. Suppose the water in the pond is well 
mixed so the concentration of salt at any given time is constant. To make 
matters worse, suppose also that at time t = 0 someone begins dumping 
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17. 
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trash into the pond at a rate of 50 m°/day. The trash settles to the 
bottom of the pond, reducing the volume by 50 m°/day. To adjust for 
the incoming trash, the rate that water flows out via stream C increases 
to 1300 m?/day and the banks of the pond do not overflow. Determine 
how the amount of salt in the pond changes over time. Does the amount 
of salt in the pond reach 0 after some time has passed? 


A large chamber contains 200 m?° of gas, 0.15% of which is carbon diox- 
ide (CO2). A ventilator exchanges 20 m?/min of this gas with new gas 
containing only 0.04% CO. How long will it be before the concentration 
of COg is reduced to half its original value? 


Problems 18-20 concern radioactive decay. The decay law states that the 
amount of radioactive substance that decays is proportional at each instant 
to the amount of substance present. 


18. 


19. 


20. 


The strength of a radioactive substance decreases 50% in a 30-day period. 
How long will it take for the radioactivity to decrease to 1% of its initial 
value? 


It is experimentally determined that every gram of radium loses 0.44 mg 
in 1 year. What length of time elapses before the radioactivity decreases 
to half its original value? 


A tin organ pipe decays with age as a result of a chemical reaction that is 
catalyzed by the decayed tin. As a result, the rate at which the tin decays 
is proportional to the product of the amount of tin left and the amount 
that has already decayed. Let M be the total amount of tin before any 
has decayed. Find the amount of decayed tin p(t). 


Problems 21-22 deal with geometric situations where the derivative arises 
and yields a separable equation. 


21. 


22. 


23. 


Find a curve for which the area of the triangle determined by the tangent, 
the ordinate to the point of tangency, and the z-axis has a constant value 
equal to a?. 


Find a curve for which the sum of the sides of a triangle constructed as 
in the previous problem has a constant value equal to b. 


On an early Monday morning in February in rural Kentucky (not far 
from Western Kentucky University) it started to snow. There had been 
no snow on the ground before. It was snowing at a steady, constant 
rate so that the thickness of the snow on the ground was increasing at 
a constant rate. A snowplow began clearing the snow from the streets 
at noon. The speed of the snowplow in clearing the snow is inversely 
proportional to the thickness of the snow. The snowplow traveled two 
miles during the first hour after noon and traveled one mile during the 
second hour after noon. At what time did it begin snowing? 
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1.5 Exact Equations 


We will now introduce another type of differential equation. Exact equa- 
tions are not separable equations nor are they necessarily linear. They come 
up in higher level math in fields such as potential theory and harmonic anal- 
ysis. 

Consider the first-order differential equation 4% = f(x,y). We observe that 


dx 
it can always be expressed in the differential form 


M(z,y) dx + N(z,y) dy =0 


or equivalently as 


dy 
M Nt —=0 
(x,y) + N(z,y) J 
and vice versa. We will now consider a type of differential equation that is 
not separable, but, nevertheless, has a solution. We need a definition from 
multivariable calculus to proceed: 


Definition 1.5.1 
Let F(a, y) be a function of two real variables such that F' has continuous 
first partial derivatives in a domain D. The total differential dF’ of F is 
defined by 

OIG) Y) an 4 OF(@Y) 


dy 


for all (x,y) € D. 


| Example 1| Suppose F(x, y) = ry? + 2a3y; then 


OF OF 
an y° +6x*y and Oy = Qry + 22° 


so that the total differential dF’ is given by 


OF (2, 
aF (x,y) = aw) 


a one: y) 


dy 


= (y? + 6ay) dx + (Qary + 2x?) dy. 
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Definition 1.5.2 
The expression 
M(a,y) dx + N(2,y) dy (1.24) 


is called an exact differential in a domain D if there exists a function F’ 
of two real variables such that this expression equals the total differential 
dF (x,y) for all (2, y) € D. That is, (1.24) is an exact differential in D if 
there exists a function F’ such that 


for all (x,y) € D. 


If M(x, y) dv + N(a, y) dy is an exact differential, then the differential equa- 
tion 
M(a,y) dx + N(a,y) dy =0 (1.25) 
is called an exact differential equation. As long as x = C (a constant) is not 
a solution, we consider the equivalent form 


d 
M(z,y) + N(z,y) 


y 
=o (1.26) 


as the standard form for an exact equation. 


| Example 2 | The differential equation 


dy 


co 


y" + 2xry 


is exact, since if F(x,y) = ry? then 


OF OF 
an cat ame 


Not all differential equations, however, are exact. Consider 


dy 


dx = 


y + 2a 


We cannot find an F(a, y) so that 


OF OF 

= =yand — = 22. 

an Oy 

Numerous trials and errors may be enough to convince us that this is the 
case. What we really need is a method for testing a differential equation for 
exactness and for constructing the corresponding function F(x, y). Both are 


contained in the following theorem and its proof. i 
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THEOREM 1.5.1 


Consider the differential equation 


M(z,y) + N(z,y) = = (1.27) 


where M and N have continuous first partial derivatives at all points 
(a, y) in a rectangular domain D. Then the differential equation (1.27) 
is exact in D, if and only if 


OM(z,y) _ ON(z,y) 
Oy Ox 


(1.28) 


for all (a, y) in D. 


Remark: The proof of this theorem is rather important, as it not only pro- 
vides a test for exactness, but also a method of solution for exact differential 
equations. 

Proof: To prove one direction of the theorem, we first suppose the differential 
equation (1.27) is exact in D and show that (1.28) must hold as a result. If 
(1.27) is exact, then there is a function F’ such that 


OF OF 
aa M(a,y) and a N(a,y). 
So 
oF aM oF aN 


dydx Oy a OxOy Ox 
by differentiation. Now we have assumed the continuity of the first partials 
of M and N in D, so that 


OF OF 
ayor Oxdy 
This means that 
OM _ ON 
Oy Ox’ 


which is the same as (1.28). 

To prove the other direction, we assume (1.28) and show that (1.27) must be 
exact. (Proving this direction will also show us how to construct the solution 
for a given exact equation.) Thus, we assume 


OM _ ON 
Oy Ox 
and find an F’ so that 


— = M(a,y) and a = N(x, y). (1.29) 
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It is clear that we can find an F' that satisfies either of these equations, but 
can we find an F that satisfies both? Let’s proceed and see what happens. 
Suppose that F' satisfies 


OF 


We can integrate both sides of this equation to get 


F(e,y) = f M(e.y) de + oly) (1.30) 


where f M(x, y) dz is the partial integration with respect to x holding y con- 
stant. Note that our “constant” of integration, é(y), is a function but is a 
function of y only (it might also include an additive constant, but definitely 
no x). This is because the expression OF'/Ox would result in the loss of any 
“only y functions.” Now we need to find an F(x, y) that satisfies both equa- 
tions in (1.29). We thus need to make sure the F(x, y) in (1.30) also satisfies 
o = N(a,y). We calculate OF /Oy by differentiating (1.30) with respect to 
y: 


“ = 5, | M@u)ae+ — 
Equating with N(a, y) gives 
New) = (5 f Maude) +80), 
where ¢'(y) = ddé(y)/dy. Solving for ¢’(y) gives 


¢'(y) = N(x, y) — 5, | Mew) dx. 


Since ¢(y) is a function of only y, it must also be the case that ¢/(y) is a 
function of only y. We can see this by showing 


2 (wv = 5, | Maw) i) =0. 
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Evaluating the left-hand side and simplifying give 


a a ON 
. (wen - 5 f ate.sae) ~ Oe sony | se 


2 
= oN - im (by noting what F is) 
2 
= oN - oa (by continuity) 
ON 
= M( 
Ox oe | (2,9) d 
_oN aM 
Ox Oy 
= 0, 


where the last equality holds since we have assumed that 


an _ aM 
Ox Oy” 


New) — 5. f M(ay)az 


cannot depend on « since its derivative with respect to x is zero. Hence, 
O 


F(e,y) = f M(e,y) de + oly) 
is a function that satisfies both 


OF 
Ox 


What this means is that 


and thus 


= M(a,y) and —— =N(z,y). 


Thus, 
dy 
is exact in D. 


In short, the criterion for exactness is (1.28): 


aN _ aM 
Ox Oy” 
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If this equation holds, then the differential equation is exact. If this is not 
true, the differential equation is not exact. 


|Example 3 | We considered the differential equation 


d 
y? +2ay 4% =0 (1.31) 
dx 
earlier. We see that 


M(z,y)=y? and N(a,y) = 2xy. 


Thus, 
OM ON 
aa 2y =A. 
Oy Ox 
so that the differential equation is exact. On the other hand, 
d 
y +20 2% =0 (1.32) 
dx 
gives M(x,y) = y and N(a,y) = 22 so that 
OM ON 
—— =142= —. 
Oy 7 Ox 
Hence y + 2x ou = 0 is not exact. a 
| Example 4 | Consider the differential equation 
: 3,2 2 2,0) FY 
(2xsiny + y°e”) + (x* cosy + 3y“e ) a =, 
x 
Here 
M(a,y) = 2esiny+y%e" and N(x,y) = 2? cosy + 3y’e"; 
hence 
eM 2x cos y + 3y7e” any 
—_ = 27 e€ ==. 
Oy pte Ox 
Thus the differential equation is exact. ‘“ 
Remark: The test for exactness applies to equations in the form 
dy 
M(a,y) + N(ax,y) a 0. (1.33) 


If the left-hand side is an exact differential, then we can solve the exact dif- 
ferential equation (1.33) by finding a function F(a, y) so that 


OF(2,y) 4, OF(@,y) iS 
Ox Oy 
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More simply, using the total differential, we obtain dF'(x,y) = 0. Thus, 
F(z,y)=C 


is a solution to (1.33). 


THEOREM 1.5.2 
Suppose the differential equation 

d 

M(z,y) + N(a,y) 2 =0 

dx 
is exact. Then the general solution of this differential equation is given 
implicitly by 

F(z,y) =C, 


where F(a, y) is a function such that 


OF OF 
pp 7 Mle) and mee 


Remark 1: As with separable and homogeneous equations, the constant in 
Theorem 1.5.2 is determined by an initial condition. 
Remark 2: We have an explicit form for F(x, y), namely, 


F(e,y) = i Mia aide 6G), 


where $(y) = [(xen- 5, | Maw) az) dy. This form, however, is 


not always useful. We will see by example how to solve exact differential 
equations. 

Remark 3: We integrated 0F'/Oz = M and substituted this into OF /Oy = N. 
We instead could have solved 0F'/Oy = N first (by integrating with respect to 
y and obtaining a “constant” w(a)) and then substituted into 0F/0x = M. 
The resulting F is the same but would be written 


F(e,y) = i. Nesp aye), (1.34) 


where w(x) = [ (ten - =f Neow) iv) dx. See Problem 19 at the 


end of this section. 


| Example 5 | Show that 


d 
(3x? + day) + (2x? + 2y) 7 =0 
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is exact and then solve it by the methods discussed in this section. 


Solution 
We have 


M(a,y) =32?+4ary and N(z,y) = 2x7 4+2y 


so that the equation is exact, since 


Our goal is to find an F(z, y) that simultaneously satisfies the equations 


OF OF 
Bp 7 Ml) and By ee 


That is, F must satisfy 


OF OF 
ae 3x27 +4ay and a Qa” ++ 2y. 


Integrating OF /Ox with respect to « gives 


F(a,y) = [or + day) da 
= 2° + 2a?y + o(y). 
This same F' must also satisfy OF /Oy = N and we then have 


OF 
2 2 / ae ee 2 : 
x + (y) Oy 2u~ + Qy 


Thus, ¢’(y) = 2y. Integrating with respect to y gives 
oy) =y"° + Co 


so that 
F(a,y) = 2° + 2x*y+y? + Co. 


Thus, a one-parameter family of solutions is given by 


go + 2e7y +y? =C. 


1.5. Exact Equations 49 


We now solve an exact equation by first integrating with respect to y; see 
Remark 3 above. 


| Example 6 | Show that 


dy a, 


(22 cosy + 3z?y) + (a? — 2? siny — y) = re 


is exact and solve it subject to the initial condition y(0) = 2. Plot the solution. 


Solution 
We have M(x,y) = 2acosy + 3x7y and N(a,y) = 2° — 2? siny — y. The 
equation is exact because 


OM (7) 
Oy. = 3x7 — 2esiny = ar" 
Now we find an F(x, y) so that 


OF 


5 = M(z,y) and oe = N(z,y). 
Ox 


Oy 


This time we will integrate OF /Oy = N with respect to y. Thus 
F (x,y) = [ New) (x,y) d 
= =1e — a’ siny — y) dy 
y? 
= gy 4+ 2? cosy — =P wa). 


This must also satisfy OF /Ox = M. Calculating OF'/Ox gives 


OF 
— = 32°y + 2rcosy+w'(z). 
Ox 
Substituting into 
OF 
—=M 
Aa (x,y) 


gives ~’(a) = 0, which is easily integrated to obtain w(x) = Ci. Thus, 
3 2 1 4 
F(a,y) = xv°y+ 27 cosy — 5Y +C1, 
and a one-parameter family of solutions is 


1 
ay + 2? cosy — au =C. 
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aa 

|) 

-4 -3 -2 -1 _— 
-14 


FIGURE 1.8: Implicit plot for Example 6. The upper curve is the solution 
curve because it passes through the initial condition. 


The initial condition y(0) = 2 gives C = —2. Hence 


1 
x” cosy + x°y — av =-2 
is the implicit solution that satisfies the given initial condition. The solution 
curves can be plotted as shown in Figure 1.8. 
Note that although both curves in Figure 1.8 satisfy the implicit equation, 
only one of these curves passes through the given initial condition and thus is 


the correct solution. - 


Solution by Grouping 


There is a much slicker method for solving exact differential equations and 

it is known as the method of grouping. For better or worse, it requires a 
“working knowledge” of differentials and a certain amount of ingenuity. We 
again consider Example 5, this time in its differential form: 


(3x? + 4xy) dx + (2x? + 2y) dy = 0. 
We rewrite it in the form 


3x? dx + (4xry dx + 2x7 dy) + 2ydy =0 


which is 
d(x?) + d(2x7y) + d(y”) = d(C). 
That is, 
d(x? + 22?y + y?) = d(C) 
so that 


x? + Qn?y+y? =C. 


Clearly, this procedure is much quicker if we can find the appropriate grouping. 
Let’s try this method one more time by again considering Example 6. We 
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group the terms as 

(22 cosy dx — x? siny dy) + (3a7y dx + 2° dy) — ydy = 0. 
Thus, we have y? 
d(x? cos y) + d(x*y) —d (4) = d(C) 


and so 1 
x’ cosy + 2°y — ow =C 
is a one-parameter family of solutions. 


Important Note: If we use the method of grouping, we still need to check 
that the equation is exact for our first step. 

e e e e e e e e e e e e 
Problems 


In Problems 1-13, check to see if the equation is exact. If it is, solve it by the 
methods of this section. If an initial is given, graph the solution. 


1. (1+ ay?) + (1+ 23y)S¢ =0 2. (1+ v sin 2x) — 2y cos 2% = 0 
3. Qey + (2? — ye = 0 4. (1 — ? sin 2x) — ycos 2a = 0 
5. Qay® + (1+ 3x?y?) dy — 6. (2 Ve + (y—+)dy =0 

2 x cos 
r.ao4(1+hny)=Qy~ 2) 8. (aly +2) + ADEE a 
9. (Qry +1) + (2? + 4y) #4 =0, y(0) =1 


10. (2ysinzcosx+y*sinz) + (sin? x — i aes #4 — 0, y(0) =3 
11. (2 —9ay?)a + (4y? — 6x*)y = 0, y(1) = 

12. (ysec? x + secxtanx) + ae + 2y) # =0, y(0) =1 
13.674 — (2y + ae-¥) @ = =0, y(1) =3 


In Problems 14-15, determine the constant A such that the equation is exact. 
Then solve the resulting exact equation. 
14. (x? + 3ry) + (Ax? +4y)# =0 15. (44+ 4) + (4 — +4) 


In Problems 16-17, determine the most general function (N(x, y) or M(a, y)) 
that makes the equation exact. 
16. M(zx, y) + (2ye” + y7e”) oy =0 17. (23 +2y?) + N(z,y) oy =0 


18. Let x represent the units of labor and y represent the units of capital. 
If f(x, y) measures the number of units produced, a differential equation 
satisfied by a level curve of it is 


a—1,,1-—a 


d 
ax’ *y + (l-a)x%y% 7m 


—=0. 
Solve this equation as (i) a separable equation and (ii) an exact equation. 


In doing (ii), we obtain the well-known Cobb-Douglas production 
function f(z, y) = Cx%y'—*. 
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19. 


20. 


21. 


Chapter 1. Traditional First-Order Differential Equations 


By following the proof of Theorem 1.5.1, show that an equivalent formu- 
lation of F(x, y) is given by 


Faw =f wow 2+ f (aew- = [xen Z). 


Although this could easily be obtained by rearranging the previously 
obtained expression for F’ (1.30), do not simply rearrange terms. 


By using the substitution y = vz, show that the homogeneous equation 


d 
(Av + By) + (Cx+ Ey) 7 = 0, 
where A, B,C, and E are constants, is exact if and only if B=C. 


By using the substitution y = vz, show that the homogeneous equation 


d 
(Aa? + Bay + Cy”) + (Ex? + Fay + Gy’) 7 =0, 


where A, B,C, E,F, and G are constants, is exact if and only if B = 2E 
and F' = 2C. 


1.6 Special Integrating Factors and Substitution Meth- 


ods 


Special Integrating Factors 


In solving linear equations, we learned that we could multiply by an appropri- 
ate integrating factor, thus transforming the equation into a form we can 
solve. Besides the one we learned, there are other integrating factors that we 
will now consider. 


Definition 1.6.1 
If the differential equation 


is not exact in a domain D but the differential equation 


is exact in D, then ju(a, y) is called an integrating factor of the differential 
equation (1.35). 


M(a,y)dz+ N(a,y) dy =0 (E35) 


U(x, y)M (x,y) dx + p(x, y)N (2, y) dy =0 (1.36) 
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| Example 1 The differential equation 


(3y + 4xy”) dx + (2a + 3x7y) dy =0 (1.37) 


is not exact since 


OM N 
OU ita BS ipa . 
Oy Ox 


If we let (x,y) = xy, we can use (1.36) to rewrite (1.37) as 
(x?y)(3y + 4ary?) da + (xy) (2x + 3a7y) dy = 0. 
Expanding gives 
M = 327y? + 4¢3y? and N = 2a3y+4+ 3a4y?. 
Then 


) fs) 
5 (3a7y? + 43 y?) = 6a?y + 122% y? = 5 (2x°y + 3xty?). 


Oy Ox 
Thus the new equation is exact and hence p(a,y) = x7y is an integrating 


factor. 
i 


We saw above how multiplying by an appropriate integrating factor con- 
verted a linear equation into an exact equation, which we could then solve. 
Multiplying by an appropriate integrating factor is a technique that will work 
in other situations as well. 

We have seen that if the equation 


M(a,y) da + N(a,y) dy =0 
is not exact and if u(x, y) is an integrating factor, then the differential equation 
w(x, y)M (a, y) dx + u(x, y)N (x,y) dy = 0 


is exact. Using the criterion for exactness, we must have 


Fy (ule, y)M (a, y)) = (ule, wN(0, 9). 


To simplify notation, we will write M,N instead of M(a,y),N(x,y) when 
taking the partial derivatives, even though both M and N are functions of x 
and y. The criterion for exactness can then be written 


Ou OM _ Op ON 
ee + p(x, y) in Oe N(a,y) + w(z,y) a 
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Rearranging gives 


N M 
Fe M(x) — SE May) = wey) Fala) Se. (1.38) 
Thus u(x, y) is an integrating factor if and only if it is a solution of the partial 
differential equation (1.38). We will not consider the solution of this partial 
differential equation. We will instead consider (1.38) in the case where ju 
only depends on 2, i.e., (x,y) = f(a). (We can also consider the case when 
(x,y) = p(y) and the analogous formulation is left as one of the exercises.) 
In this situation, (1.38) reduces to 


ON OM 
—# (a) N(a,y) = wz) B - ( oy 
That is, 
1 du 1 OM ON 
aoe 7 Wem (oy oe) oe 


If the right-hand side of (1.39) involves two dependent variables, we run into 
trouble. If, however, it depends only upon xz, then Equation (1.39) is separa- 
ble, in which case we obtain 


ue) =e | f ay (Seo ae) I 


as an integrating factor. 


| Example 2 | Solve the differential equation 


(2x? + y) dx + (x?y — x) dy = 0. 


Solution 
In this equation, 


M(z,y)=22?+y and N(z,y)=2°y—2 


so that aM aN 

— =1 4 2Qzy-1 = — 

ies ax 
and the equation is not exact. It can also be shown (try it!) that the differ- 
ential equation is not separable, homogeneous, or linear. Now 


1 OM ON 1 
N(x, y) ( Oy ~) = ae (2ay — 1)) 
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depends only upon z. Thus, 


2 1 
j(x) = exp (-/ . i) =e Al a 


is an integrating factor. If we multiply the equation through by this factor we 


have 
1 
(2+ a) de € ) ty=0 
x x 


Now this equation is exact since 


We can thus solve this differential equation using the exact method to obtain 


2 


ie ee ep 
2 x 


1.6.1 Bernoulli Equation 


We will now consider a class of differential equations that can be reduced 
to linear equations by an appropriate transformation. These equations are 
called Bernoulli equations and often arise in applications. 


Definition 1.6.2 


A first-order differential equation of the form 
—+P(rz)y=Q(az)y” neER (1.40) 


is called a Bernoulli differential equation. 


Note that when n = 0 or n = 1, the Bernoulli equation is actually a linear 
equation and can be solved as such. When n ¥ 0 or 1, then we must consider 
an additional method. 


THEOREM 1.6.1 


Suppose n # 0 or 1, then the transformation 


l=—n 


O=7 


56 Chapter 1. Traditional First-Order Differential Equations 


reduces the Bernoulli equation (1.40) to 


—+4t d= plew@)o= = now), (1.41) 


which is a linear equation in v. 


Proof: Multiply the Bernoulli equation by y~” and thus obtain 
eee + P(z)y'" = Q(x). (1.42) 


Now let v = y~” so that 


dv _ _» dy 
dx ay dx’ 
Hence, Equation (1.42) becomes 
1 dv 
=F + Plo) = Ao), 
that is, 
| i= rei 
dat A ~ M)P(2)¥ = (1-2) Q(z) 
Letting 
Pi(z)=(1—n)P(z) and Qi(x) = (1—n)Q(a) 
gives 
d 
7 + Pi(x)v = Qi(2), 


a linear differential equation in v. 


| Example 3 | Solve the differential equation 


ou +y=cy? 

Solution 

This is a Bernoulli equation with n = 3. We thus let v = y'~3 = y~?, so that 
= = —2y-3 s 

Using (1.41) we obtain 
es Qu = —22. (1.43) 
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This is a linear differential equation with integrating factor 


sep ( / P(x) ar) = ( / 9 ax) = 6, 


We also calculate exp (— f P(x) dz) = e?*. Thus the solution of (1.43) can be 


written 
v=e* (/ —2Qxre~ 2” ar) , 


Integrating by parts gives 
2a —22 it —22 2x 
v=e™ | re ™ + 5e +02". 


Simplifying gives 


1 
v=at+5+Ce™. 


But our original problem was in the variable y. We know v = y~? and thus 
the solution is 


which can be written as 


1 1/2 
v-+ (am) ; 


This solution is defined as long as the denominator is not equal to zero. 


1.6.2 Homogeneous Equations of the Form g(y/z) 


We have now been introduced to separable differential equations and their 
relative ease of solution. We will now consider a class of differential equations 
that can be reduced to separable equations by a change of variables. 


Remark: Before proceeding, we alert the reader that the use of the word 
homogeneous in this section must not be confused with its use as the type 
of linear ordinary differential equation whose right-hand side is zero (as in 
Chapters 3 and 4). Its use in the latter chapters is more common but both 
have their place. 


| Example 4 | ~ Consider the differential equation 


dy  @-y 


de x+y 
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Solution 
After a minute or so of reflection, we see that this is not a separable equation. 
We can, however, rewrite the equation as 


(1.44) 


so that we can isolate the fraction y/x. This suggests we consider the change 
of variable 


_Y 
ja 
x 
or equivalently 
Yy = v2. 


Our original problem has dy/dzx and thus we take the derivative of both sides 
of the above equation with respect to x to get 
dy du 
r—. 
dx dx 


Simplifying results in the separable equation 
dv 1—2u—v? 
dx l+uv 
and we separate its variables as 

Il+u dx 


v= 
1—2v—v? x’ 


x 


? 


and integrate to give 


In |1 — 2v — v?| = -2Inz+C. 


Exponentiation of both sides yields 
[1 —20 —y"| = ee? = Con. 


But, v = y/z so that substitution gives 


1— a _ (“) — +Cox~? =Cxr~?. 


Multiplying by x? to clear the fraction gives 
z* —Qwy—y=C 


as the implicit solution to the differential equation. = 


This is an example of a general method of reducing a class of differential 
equations to that of a separable equation. We need some terminology. 
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Definition 1.6.3 
The first-order differential equation 
dy 
M N —=0 
(x,y) + N(z,y) + 
is said to be of homogeneous type (or homogeneous) if, when written in 
the derivative form 
ob = F(2,y) 
dz a +Y ci 
there exists a function g such that f(x,y) can be expressed in the form 
g(y/x). 


By classifying the equation as homogeneous, we will be able to apply the 
above technique in order to reduce the differential equation to one that is 
separable. It is sometimes not obvious that a given equation can be rewritten 
as a homogeneous equation. We present two examples now to help clarify this 
concept. 


| Example 5 The differential equation 


dy 
dx 


is homogeneous, since the equation can be written in derivative form as 


(x? — 3y”) + 2ay 0 


dy _ 3y? — x? 
dx —- lay 


and we can rearrange this as 
5 a (2) ier at 
Qey  2\a 2\y/a 


dy 3 (4) 1/1 

de 2\e 2\y/a/)- 
The right-hand side is of the form g(y/x) for the function 
_ 38z 1 
~ 2 Og" 


and so the differential equation is homogeneous. 


so that 


g(2) 


| Example 6 | © The differential equation 
(u+ Vx? +) dx — xdy =0 
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can be written as 


dy ytV/art+y? 
dx xL , 


For z > 0, we have 


yt very Yh el 
zr é] 


sO 


d 2 
a2 4 fit (2) 
dx 2 


which is of the form g(y/x) for a function of the form 
g(z)=z4+V14+2?. 
If we had considered x < 0, we would have obtained 


g(z) =z-V14+2?. 


In either case, we see that the differential equation is homogeneous. = 


As we mentioned, we have introduced homogeneous differential equations 
because they are related to separable equations; in fact, we have the following 
theorem which formalizes the method used in Example 4. 


THEOREM 1.6.2 
If 


M(z,y) +N(a,9) 2 =) (1.45) 


is a homogeneous equation, then the change of variables 
Y= wie 


transforms (1.45) into a separable equation in the variables v and «. 


Note that this change of variables implies that 
y =v4+av' 


by the product rule. 


| Example 7 Solve 
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Solution 
We first observe that this can be rewritten as 
dy __ iy 
dx Qy-x 
Dividing numerator and denominator by x gives 
dy _ ou /e 
dx 2y/x—1 


The right-hand side is then of the form g(y/x) and making the change of 
variables y = va gives 


du v 
Ue 8 oe Be 1 
which becomes 
dv 2(u—v?) 
“de  Qu—1 
This equation is separable! Rearranging gives 
2v—1 1 
2(v — v?) x a 


and integrating both sides yields 


1 
5 Inju v*| =In|z|+ Cy. 
We then use v = y/x to reintroduce the y-variable. Thus 
2 
v0) [=mnlel +0, 
x 
but we can let C; = InC for an arbitrary constant C, so that 


a (4) =In|Ca| 


x 


1 


— In 


1 
5 in 


is the implicit solution. We could obtain an explicit solution with a bit more 
work but choose not to. Again, we could plot these solutions for various C- 
values with our favorite software package. 


2] 
e e e e e e e e e e e e 
Problems 
Solve Problems 1-8 by first finding an integrating factor of suitable form. 
1. ydx + (e* — 1)dy =0 2. (27 + y2 +2)dx + ydy =0 
3. y(x + y)dx + (ay + 1)dy = 0 A. (a? —y? + y)dx + x(2y — 1)dy =0 
5. ydx — xdy = 22° sine dx 6. (3a? + y) du + (x?y — x) dy =0 
7. (327y — x”)dx + dy =0 8. (a? + 2a + y)dx = (x — 3x7 y)dy 
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9. Show that if (0N/Ox—OM/dy)/(xM —yN) depends only on the product 


xy, that is, 
ON _ OM 
Ox ~Oy 
SS eal 
rM —yN (vy), 


then the equation 
M(a,y) dz + N(x, y) dy =0 


has an integrating factor of the form ju(xy). Find the general formula for 
pry). 


10. We derived a formula for an integrating factor if u(z,y) = p(x). If 
u(x, y) = u(y), derive the integrating factor formula 


non =e | aay (Ge oe) a 


Solve the Bernoulli equations given in Problems 11-21. 


11. y' +y = ay 12. y +3y = y4 

13. y/ + 2xy = 4y 14. y/ — zy = zy? 

15. cydy = (y? +2)dz 16. zy’ + 2y + z°y%e” =0 
17. oy - 20° fy = fy 18.y =y*cosxr+ytanz 
19. xy?y! = 27 +y? 20. (x +1)(y +y?) =-y 
21. Solve the logistic equation 4 s+ =rN (1 a x). 


For Problems 22-34, solve the homogeneous differential equation analyti- 
cally. 


22. (a+ y)dx—ady=0 23. eS ue 8 

24. (y? — 2xy)dx + x7dy =0 25. i y = a — y*) 

26. 227 = 2? +y? 27.2 a att 

28. ry’ —y = rtan(4) 29. (2? es 2)y! = 2xry 

30. ydx = (2x + y)dy 31. («— y)dx + (x + y)dy =0 
32. y/ = erode 33. y? + 2?y! = zyy! 


34. (a + 4y)y! = 2a + 3y 
35. A function F' is called homogeneous of degree n if 
F(ta,ty) =t" F(a,y) for all « and y. 


That is, if ta and ty are substituted for x and y in F(a, y) and if t” is then 
factored out, we are left with F(x, y). For instance, if F(x, y) = 2? + y?, 
we note that 


F (ta, ty) = (ta)? + (ty)? =tF (a, y) 


36. 
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so that F’ is homogeneous of degree 2. Homogeneous differential equa- 
tions and functions that are homogeneous of degree n are related in the 
following manner. Suppose the functions M and N in the differential 
equation 

M(a,y)dx+ N(x,y) dy =0 


are both homogeneous of the same degree n. 
(a) Show, using the change of variables t = 1/z, that 


1 n 
x £ 
which implies that 


M(x, y) = (=) "MM (1, 4 


(b) Show, using a similar calculation, that 


wen=(2) "(9 


so that the differential equation 


M(a,y) dx + N(a,y) dy =0 


becomes 
dy _—M(x,y)__ (4) "M(.4) 
dx N(a,y) (4) " N(1, 2) 
Simplifying gives 
dy __ M(1, 4) 
dz N(1, 4)’ 


(c) Show that both numerator and denominator of the right-hand side of 
dy M(1,%) 
dx  N(i,¥%) 


are in the form g(y/x) and conclude that if M and N are both homoge- 
neous functions of the same degree n, then the differential equation 


M(a,y) dx + N(2x,y) dy =0 


is a homogeneous differential equation. 


Using the idea presented in Problem 35, show that each of the equations 
in Problems 22-34 are homogeneous. 
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37. Suppose that the equation M(x, y) dx + N(a,y) dy = 0 is homogeneous. 
Show that the transformation z = rcost, y= rsint reduces this equa- 
tion to a separable equation in the variables r and t. 


Use the method of Problem 37 to solve Problems 38-39. 


38. (x — y)da + (x + y)dy = 0 39. (a+ y) dx —xdy =0 
AO. (a) Solve 
dy y-2 
dx yt 
(b) Now consider 
d - 1 
ce ie ie eam (1.47) 
dx y+auat+5 


(i) Show that this equation is NOT homogeneous. 

How can we solve this? Consider the equations y—« =0 and y+a=0. 
They represent two straight lines through the origin. The intersection of 
y—-x+1=O0and y+2+4+5 =0 is (—2,—3). Check it! Let « = X — 2 
and y = Y —3. This amounts to taking new axes parallel to the old with 
an origin at (—2, —3). 

(ii) Use this transformation to obtain the differential equation 


dY Y-X 
dX Y+xX’ 


(iii) Using the solution from part (a), obtain the solution to (1.47). 


Use the technique of Problem 40 to solve Problems 41-45. 
41. (2a +y+1)dr — (4x + 2y — 3)dy = 0 
42.c¢—-y—1+(y—2+2)y’ =0 

43. (x + 4y)y! = 2a + 3y—5 

4A. (y+ 2)dx = (2% + y — 4)dy 


45. y' =2(4*) 


Chapter 1 Review 


In Problems 1—7, determine whether the statement is true or false. If it is 
true, give reasons for your answer. If it is false, give a counterexample or 
other explanation of why it is false. 


1. The equation y” + zy’ — y = 2? is a linear ordinary differential equation 
that is considered an initial-value problem. 
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2. The equation y —y? =sinz is anonlinear ordinary differential equation. 

3. An implicit solution to y’ = f(a,y) can be written in the form y(a) = 
f(z). 

4. With an appropriate substitution, any exact equation can be put in the 
form of a linear equation. 


5. A solution to the differential equation y’ = f(x,y) must be defined for 
all x. 


6. An equation of the form M(a,y) + N(2,y)y’ = 0 is considered exact if 


OM(z,y) _ ON(zx,y) 
Oy Or 


7. Every equation of the form y’ = f(y) is separable. 


In Problems 8-11, verify that the given function is a solution (possibly im- 
plicit) to the given differential equation. State the interval on which it is a 
solution and the C-values for which the solution is valid. 

8. y(z) =1+Ce® ,y =403(y—1) 9. y(x) = Ce* — 2? -22-2,y' =a? +y 


37-14 3C 
10. 7” = ——_ ,7'/= y? 11. =, y' = (y—3)? 
y(t) = Grea W =Y y(z) aro = 3) 
In Problems 12-16, solve each of the following separable differential equations. 
12. y! — ay? = 2ry 13. 2x7yy' + y? =2 
14.e°7(14+ @)=1 15. ay +y=y? y(1)=05 


16. y' =3V/y? y(2) =0 


In Problems 17-22, solve each of the following homogeneous differential equa- 
tions. 


17. cy! = y — xe¥/* 18. zy’ —y=(x+y) In 2 

19. xy’ = ycos(In(4)) 20. (y+ ./xy)dx = xdy 

21. ry! = Vr? -y?+y 22. (2x — 4y)da + (x + y)dy =0 

In Problems 23-25, solve each of the following exact differential equations. 
d 

23. = +(y° Inn) =0 


d 
24. 2a(1 + Vx? — y) — V2? v5, =9 


Ba2+y? 2a +5ydy _ 
: rr 
In Problems 26-28, solve each of the following differential equations by first 
finding an integrating factor of a suitable form. 
26. ry?(zy’ + y) =1 27. y*dx — (ry + x3)dy =0 
28. (y—i)dr+ % =0 


25 0 


ys dx 


In Problems 29-34, solve the following linear or Bernoulli equations. 
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29. xy’ +y= 21 30. y/ —y=sinaz 

31. y' + 4zy = 5x3 32. ry’ +y = xy" 

33. y/ —y = zy 34. 2y' + ry = 4ry 


Solve the remaining problems using one of the methods of this chapter. 


35. 


36. 


37. 


38. 


39. 


One Big OV’ Pot of Soup Mike, a professor of mathematics and a part- 
time evening cook at a local diner, prepares a big pot of soup late at night, 
just before closing time. He does this so that there would be plenty of 
soup to feed customers the next day. Being food safety cautious, he knows 
that refrigeration is essential to preserve the soup overnight; however, the 
soup is too hot to be put directly into the fridge when it is ready. (The 
soup had just boiled at 100°C, and the fridge is not powerful enough to 
accommodate a big pot of soup if it is any warmer than 20°C.) Mike 
is resourceful (as he is a student of M.M. Rao) and discovered that by 
cooling the pot in a sink full of cold water (kept running, so that its 
temperature was roughly constant at 5°C) and stirring occasionally, he 
could bring the temperature of the soup to 60°C in 10 min. How long 
before closing time should the soup be ready so that Mike could put it in 
the fridge? 


A cup of very hot coffee from a fast food restaurant is at 120°F when it is 
served. If left on the table in a room with ambient temperature of 70°F, 
it is found to have cooled to 115°F in 1 min. If burns can result from 
spilling coffee at a temperature greater than 100°F, how many minutes 
will the coffee have to sit before the management is safe from lawsuits? 


A 30-gal tank initially has 15 gal of saltwater containing 6 lb of salt. 
Saltwater containing 1 lb of salt per gallon is pumped into the top of 
the tank at the rate of 2 gal/min, while a well-mixed solution leaves the 
bottom of the tank at a rate of 1 gal/min. Determine the amount of salt 
in the tank at time t. How long does it take for the tank to fill? What is 
the amount of salt in the tank when it is full? 


A 100-gal tank initially contains 100 gal of sugar-water at a concentration 
of 0.25 lb of sugar per gallon. Suppose sugar is added to the tank at a 
rate of p lb/min, sugar-water is removed at a rate of 1 gal/min, and the 
water in the tank is kept well mixed. Determine the concentration of 
sugar at time t. What value of p should be chosen so that, when 5 gal of 
sugar solution is left in the tank, the concentration is 0.5 lb of sugar per 
gallon? 


Find a curve such that the point of intersection of an arbitrary tangent 
with the x-axis has an abscissa half as great as the abscissa of the point 
of tangency. 
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Chapter 1 Computer Labs 


The reader should only complete the computer lab(s) after reading Ap- 
pendix A, where the introductory details and some basic commands and ex- 
amples are given. Although every attempt has been made to make the syntax 
given in this book applicable to a range of versions/releases, certain syntax 
may be different for an earlier or later version of a given package. We assume 
the reader has no familiarity with any package but has access to at least one of 
them. From this point, we will assume the reader is familiar with the relevant 
section of Appendix A. 


Chapter 1 Computer Lab: MATLAB 


MATLAB Example 1: Enter the following code that demonstrates how 
to differentiate and integrate functions using the Symbolic Math Toolboz. 
It considers f(x) = cosx + e2* + Ina and calculates f’(x), f’(«), G2 


} f@jds, ie f(a)dx, and ih oven: aa 


S=> Glleene cull 

>> syms x t 

>> f(x)=cos(x)+exp(2*x)+log (x) 
SS> lalaeat Cie Ge) 238) 

SS> clalsti? GE Ge) o32,) 

SS Ghia GiGs) ow) 

>> int (f(x) ,x) 

SS alge (Gee) ,3¢,@p jou) 

>> quad(’cos(x)+exp(2*x)+log(x)’,0,pi) “definite int w/o syms 
=> ant (f(x) ,t) 

> f£(t)=subs(f (x) ,x,t) 

>> g(x)=int (f(t) ,0,x) 

> g(pi) 


MATLAB Example 2: Enter the following code that demonstrates how 
to verify that a given function is a solution (possibly implicit) to the differ- 
ential equation. The Symbolic Math Toolbox is again needed. It considers 
y” + 2y' +y = 0 with explicit solutions y, = e~* and ya = xe~*, followed by 
(2 — 4) y* — 2° (y? — 3)y’ = 0 with implicit solution =++ 3 == + 5 +C. 


x 


>> clear all 
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>> syms x y@) C 

>> eql=diff(y(x) ,x,2)+2*diff(y(x) ,x)+y(x) 

>> subs(eqi,y(x) ,exp(-x)) 

>> subs(eqi,y(x) ,x*exp(-x)) 

> subs(eql,y(x) ,exp(x)) 

>> eq2=(x-4) *y (x) 4-x3* (y (x) 2-3) *diff (y (x) ,x) 
S> sol2=-1/x+2/x2+1/y (x) -1/y (x) 3-C 

>> dsol2=diff(sol2,x) 

>> collect (expand (y(x)4*x"3*dsol2) , diff (y (x) ,x)) 


MATLAB Example 3: Enter the following code that demonstrates how to 
plot one implicit function (in this case a solution to a differential equation) 
and then multiple plots with the same function but different constants. It con- 


siders the implicit solution from MATLAB Example 2, — = = = = +C. 


> clear all 

SS PG Nd smesinereiiel(—23 .Oile2, 28 .OileD) 
SS 4 POD fOr ARO Ss 

SS CGompoureOl, 7%, lS =|) 

>> ([C,h]=contour(X,Y,Z,[-5 -5]); 

>> clabel(C,h) 

SS exals([-2 2 © @.Gl|) 

>> xlabel(’x’), ylabel(’y’) 

Sect le @impillacatePilotewathec——be)) 
>> [C,h]=contour(X,Y,Z,[-10,2,6,50]); 
>> clabel(C,h) 

>> xlabel(’x’), ylabel(’y’) 

>> title(’Implicit Plot with C=-10,2,6,50’) 


MATLAB Example 4: We will now numerically solve 


(ag? + 1)y +4zy=a2, (0) = 10. 


In the code below, you will first create a MATLAB function (separate 
file) called Example4.m. Then you will use MATLAB’s ode45 to plot the 
approximate numerical solution. 


hhh Create a function, Example4.m, and save it. 
function dydx=Example4 (xn, yn) 

hh 

“Rewrite the original ode in the form y’=f(x,y) 
%to obtain y’=(x-4xy) /(x2+1) 

hh 

dydx=(xn-4*xn*yn) /(xn%2+1) ; 
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% Now type the following in the command window. 


= 
= 
= 
= 
= 


LE 
= 
Le 
= 
= 
= 


clicarmmalel: 

[x,y]=ode45 (@Example4, [0,4] ,10); 

plot (x,y) 

subplot (2,1,1) ,plot(x,y) 

title(’Numerical Approximation of Soln of (x/2+1)y{\prime} 
+4xy=x, y(0)=10’) 

xlabel(’x’), ylabel(’y’) 

x1=0:.1:4; 

y1=((1/4) *x1.%4+(1/2)*x1.%2+10) ./(x1.%2+1) 2; 

subplot (2,1,2),plot(x1,y1,’k’) 

title(’Closed Form Soln of (x2+1)y{\prime}+4xy=x,y(0)=10’) 
xlabel(’x’), ylabel(’y’) 


MATLAB Exercises 

Turn in both the commands that you enter for the exercises below as well as 
the output/figures. These should all be in one document. Please highlight or 
clearly indicate all requested answers. Some of the questions will require you 
to modify the above MATLAB code to answer them. 


il, 


Enter the commands given in MATLAB Example 1 and submit both your 
input and output. 
Enter the commands given in MATLAB Example 2 and submit both your 
input and output. 
Enter the commands given in MATLAB Example 3 and submit both your 
input and output. 


Enter the commands given in MATLAB Example 4 and submit both your 
input and output. 


Find the derivative of t? + cost with respect to t. 

Find the derivative of x? + cosx with respect to x. 

Find the second derivative of t? + cost with respect to t. 
Find the second derivative of x? + cosa with respect to «. 
Find the antiderivative of t? + cost with respect to t. 
Find the antiderivative of x? + cosx with respect to x. 


. Find the derivative of In(tz) + cos? x + sin t? with respect to t. 

. Find the derivative of e + cos? 2 + sint? with respect to 2. 

. Find the antiderivative of In(tx) + cos? x + sint? with respect to t. 
. Find the antiderivative of e“ + cos? x + sint? with respect to 2. 

. Find the definite integral of x? + cosx from x = 0 to x = 3. 

. Find the definite integral of nz from « = 1 to x =5. 
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17. 


18. 


19. 


20. 


Pale 


De 


23. 


24. 


25. 


26. 


Die 


28. 
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Find the definite integral of e~” from x = —1 to x = 3. Give the answer 
as a decimal. You may find it easier to use quad rather than the Symbolic 
Math Toolbox. 

Find the definite integral of 


as a decimal. You may find it easier to use quad rather than the Symbolic 
Math Toolbox. 


Numerically verify that y(x) = sinx + 2cosz is a solution on (—oo, co) 


sin x : 
from z = 1 to x = 10. Give the answer 


Numerically verify that yi(#) = e*, yo(x) = xe* are both solutions on 
(—o0, 00) to y” — 2y’ +y =0. 

Solve y’ = sin(x?), y(0) = 0 by hand. Then use MATLAB to find 
y(1), y(3). (Hint: remember, from Calculus, that y(a) = th f(t)dt isa 
function of x and thus y(1) is a number that can be evaluated with the 
above code.) Use MATLAB to plot the solution from x = 0 to x = 4. 
Use MATLAB to numerically solve y’ = sin(x”), y(0) = 0. Plot this 
numerical solution from « = 0 to x =4. 


Solve y’ = sin) y(1) = 0 by hand. Then use MATLAB to find 
z 


y(2), y(3). (Hint: remember, from Calculus, that y(x) = fy f(t)dt is a 
function of x and thus y(2) is a number that can be evaluated with the 
above code.) Use MATLAB to plot the solution from x = 1 to « = 6. 


Use MATLAB to numerically solve y’ = ney y(1) = 0. Plot this 
x 


numerical solution from « = 1 to 7 = 6. 
Numerically verify that y—y° +cosa+zsinz = C is an implicit solution 
to the ODE (1 — 6y®)y’ = —x cosa. 


Solve y+ ry’ = — by hand. This solution is implicit. Choose 3 
y— 
different C-values and plot the implicit solutions. 


Consider the equation 
2 | il _ 
ey aa erare 


in which y is an implicit function of z. Give an implicit plot of the 
equation for O' = 2,4,10 for x € [—3, 3], y € [—3, 4]. 
Consider the equation 


2 Den. 
1=2-8 —3y Tr — OF 


in which y is an implicit function of z. Give an implicit plot of the 
equation for C' = .1,.5,.9 with x € [—3, 3], y € [—1, 1]. 
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29. We will learn in a later chapter that the solution of a differential equation 
is sometimes written in the form of a series. There is a code in Appendix 
A that plots the Taylor series of sinx about x = 0 for a given number of 
terms and over a given interval. Modify this code to show numerically 
that 


=e poe 1.4 
is the solution of y! = y+ 27, y(0) = 1. Find the analytical solution of this 
ODE (either by hand or using dsolve [in R2012 or later]) and compare it 
to the 5-, 6-, and 7-term series expansion (1.48) over the interval [—4, 4]. 


Chapter 1 Computer Lab: Maple 


For Maple, many of the commands are entered via the basic input palette. 
For example, the integral sign, the exponential function, and fractions are 
all entered with the palette to make it aesthetically pleasing; alternatively, 
there are commands that could be entered directly. See Appendix A for more 
details. 

Maple Example 1: Enter the following code that demonstrates how to 
differentiate and integrate functions. It ee i@) = cosa e2* + Ina 
and calculates f’(x), f(x), BS. J f(a)dz, fo f(x)dx, and fy f(t)dt. Please 
note that the derivative symbol that appears ie is always ae from 


d 
ae 


the Expression palette 


restart 
f = 2 cos(x) +e7” + In(z) 
diff f(x), x) 


me (a) #the derivative symbol was entered from the Expression palette 
i 
diff f(x), $2) 
ad? 
ans (x) #the second derivative symbol was modified from the 
ae 
Expression palette entry by inserting the power of 2 
aigl (x), t) 
A (x) 
int( f(x), x) 
f (a) dx #entered from Expression; if from Common Symbols, 
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palette needs to use d_ from there too 
fia if((4)), ae = O).cIPri) 


Maple Example 2: Enter the following code that demonstrates how to 
verify that a given function is a solution (possibly implicit) to the differential 
equation. It considers y” + 2y’ + y = 0 with explicit solutions y; = e~” and 
y2 = ze—*, followed by (a — 4) y* — x? (y? — 3)y’ = 0 with implicit solution 
Fee po 


iw ae y 


restart checking a solution, plotting implicit solutions 


d d 
cat == Fula) +2 Zula) +y(a)=0 
eval (subs (y Qa, *eq1)) # Note that e is entered from the palette 
eval (subs (y (x) = a-e~*, eq1)) 
eval (subs (y (x) = e” veg) #this is NOT a solution 
d 
eq2 = («—4)-y(x)* — 23 - (y(x)? —3)- qgd () =9 
2 il 1 
sol2 := : ao =C€C 
dsol2 : = implicitdiff (sol2, y,x£) #this is y' 


solve (cae. “y (2) #this is the rhs of the ODE, written as y' =f(z,y(x)) 
a 


Maple Example 3: Enter the following code that demonstrates how to 
plot one implicit function (in this case a solution to a differential equation) 
and then multiple plots with the same function but different constants. It 


considers the implicit solution from Maple Example 2, — = = = 7 EC. 
restart 
with(plots) : #loads package for implicit plotting 
il 2 il 1 
sole = =C 


a ae yp 
implicitplot (subs (C = —5, sol2) ,a = —2..2,y = —2..2 
gridrefine = 4, title =" Implicit Plot with C=-5") 
implicitplot ({subs (es = —10,s0l12), subs (C = 2, sol2), subs (C = 6, sol2) , 
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subs (C = 50, sol2)|, « = —2..2, y = —2..2, gridrefine = 4, title = 
"Implicit Plot with C=-10,2,6,50", legend = [”C=-10" ,” C=2” ,"C=6", 
” C=50")) 


Maple Example 4: We will now numerically solve 


(2? +1)y +4ey=2, y(0) = 10. 
In the code below, you will use the Maple package DEtool1s to do this. 


restart 

with(DEtools) : 

with(plots) : 

eq := (27 +1)- Hy(a) +4--y(20) = 

DEplot (eq3,y (a) , x = 0..4, [y (0) = 10], linecolor = blue, arrows = none, 
title =" Numerical Approximation of Solution of(x*2 + 1)y\'(x)+ 
dscy(x) = x, y(0) = 10") 

sol3 := dsolve ({eq3,y (0) = 10}) 

plot (rhs (sol3) ,x = 0..5, color =" Gray”, title =" Closed Form Solution of 

(«92+ L)y\"(x) + 4xy(e) = x, y(0) = 10") 


Maple Exercises 

Turn in both the commands that you enter for the exercises below as well as 
the output/figures. These should all be in one document. Please highlight or 
clearly indicate all requested answers. Some of the questions will require you 
to modify the above Maple code to answer them. 


1. Enter the commands given in Maple Example 1 and submit both your 
input and output. 
2. Enter the commands given in Maple Example 2 and submit both your 
input and output. 
3. Enter the commands given in Maple Example 3 and submit both your 
input and output. 


4. Enter the commands given in Maple Example 4 and submit both your 
input and output. 


5. Find the derivative of t? + cost with respect to t. 
6. Find the derivative of 7? + cosx with respect to x. 
7. Find the second derivative of t? + cost with respect to t. 
8. Find the second derivative of «? + cosx with respect to x. 
9. Find the antiderivative of t? + cost with respect to t. 

10. Find the antiderivative of x? + cosx with respect to x. 
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fe 
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19. 


20. 
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24. 


25. 


26. 


Die 
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Find the derivative of In(tx) + cos* x + sint? with respect to t. 

Find the derivative of e + cos? x + sint? with respect to x. 

Find the antiderivative of In(tz) + cos? x + sin t? with respect to t. 

Find the antiderivative of e’” + cos? + sint? with respect to 2. 

Find the definite integral of x? + cosx from x = 0 to x = 3. 

Find the definite integral of Inz from 7 = 1 to x = 5. 

Find the definite integral of e~” from « = —1 to z = 3. Give the answer 


as a decimal. You will likely need to use evalf. 


Find the definite integral of aa 


as a decimal. You will likely need to use evalf. 


from z = 1 to x = 10. Give the answer 


Numerically verify that y(x) = sinx + 2cos« is a solution on (—co, co) 


Numerically verify that yi(”) = e”, yo(x) = xe” are both solutions on 
(—o0, 00) to y” — 2y’ +y =0. 

Solve y’ = sin(x”), y(0) = 0 by hand. Then use Maple to find y(1), (3). 
(Hint: remember, from Calculus, that y(x) = if f(t)dt is a function of «x 
and thus y(1) is a number that can be evaluated with the above code.) 
Use Maple to plot the solution from 7 = 0 to x = 4. 

Use Maple to numerically solve y’ = sin(x?), y(0) =0. Plot this numer- 
ical solution from « = 0 to # = 4. 


Sa) y(1) = 0 by hand. Then use Maple to find y(2), y(3). 


(Hint: remember, from Calculus, that y(v) = J," f(t)dt is a function of x 
and thus y(2) is a number that can be evaluated with the above code.) 
Use Maple to plot the solution from « = 1 to 7 = 6. 


Use Maple to numerically solve y/ = ene) y(1) = 0. Plot this numer- 


Solve y’ = 


ical solution from « = 1 to x = 6. 

Numerically verify that y—y® + cosa+2sinx = C is an implicit solution 
to the ODE (1 — 6y)y’ = —zx cosa. 

ae 
2y—1 
different C-values and plot the implicit solutions. 


Solve y+ xy! = by hand. This solution is implicit. Choose 3 


Consider the equation 
2 | 1 — 
Ve G27 Pay? 


in which y is an implicit function of z. Give an implicit plot of the 
equation for CO = 2,4,10 for x € [—3, 3], y € [—3, 4]. 


28. 


BY), 
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Consider the equation 


2 2 
l-e” 8) el — (6! 


in which y is an implicit function of x. Give an implicit plot of the 
equation for C = .1,.5,.9 with x € [—3, 3], y € [—1, 1]. 

We will learn in a later chapter that the solution of a differential equation 
is sometimes written in the form of a series. There is a Maple procedure 
in Appendix A that plots the Taylor series of sina about « = O for a 
given number of terms and over a given interval. Modify this code to 
show numerically that 


y=1lte+—4 foe (1.49) 


is the solution of y’ = y + x, y(0) = 1. Find the analytical solution of 
this ODE (either by hand or using dsolve) and compare it to the 5-, 6-, 
and 7-term expansion (1.49) over the interval [—4, 4]. 


Chapter 1 Computer Lab: Mathematica 


For Mathematica, many of the commands are entered via the basic input 
palette. For example, the integral sign, the exponential function, and 
fractions are all entered with the palette to make it aesthetically pleasing; 
alternatively, there are commands that could be entered directly. See 
Appendix A for more details. 


Mathematica Example 1: Enter the following code that demonstrates how 


to differentiate and meee a ae It coe f(x) = cosa : a +Inaz 
and calculates f’(a), f’ (2), at) 2) f f(a) )dx, fy f(x)dx, and fy f 


Quit|] 

f[x_] = Cos[x] + e?* +Log|x] (*all entered from palette*) 
D([f [x] ,x] 

22? |e] 

1D) [Ere (el) yee, 2I1 

12°? [Lye] 

D[f [x] ,t] 


ft{x|dx 
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Integrate [f [x] ,x] 
iE f[x|d x 

i f[xJdt 

g(x] =/S4[t]dt 
gl] 

N[gl7]] 


Mathematica Example 2: Enter the following code that demonstrates 
how to verify that a given function is a solution (possibly implicit) to the 
differential equation. It considers y/’ + 2y’ + y = 0 with explicit solutions 
* and yo = xe~*, followed by (x — 4) y* — x? (y? — 3)y’ = 0 with 


y= ec 
implicit solution =} + 3 =—=+4+C. 
Quit| | 


elagil lixe_]] = y?? [bel] 2 wy? [bel] se Wile] 
(*note the space for multiplication in above line*) 
ReplaceAll[deqilx], {y[x] ~e*, y’[x] — Dle™*, x], 

y’’? [x] — Dle™*, {x,2}]}] 

ReplaceAll[deqilx], {y[x] ~ xe“, y’[x] > Dlxe™, x], 

Wo? |bal => Dike, fee, 21 
FullSimplify[%] 

ReplaceAll[deqilx], {y[x] > e*, y’[x] — Dle*, x], 

y’’? [x] — Dle*, {x,2}]}] (*This is NOT a solution*) 
deq2[x_] = 2 - = y lx)" - a (y[x]? - 3) y’ [x] 
sone et ed yee 
dsol2 = D[sol2[x], x] 

Solve[dsol2 == 0, y’ [x]] 
Solve[deq2[x] == 0, y’ [x]] 


Mathematica Example 3: Enter the following code that demonstrates 
how to plot one implicit function (in this case a solution to a differential 
equation) and then multiple plots with the same function but different 


constants. It considers the implicit solution from Mathematica Example 2, 
ale 


x q e2 _@ y l y? T 
Quit| | 

or es ee 
solo sca s =a a 


CompomdmMlow [sol2|be, yil==-5, tx, —2, Zl, ty, —2, Bh. 
PlotPoints — 20, PlotLabel — "Implicit Plot with C=-5"] 

ContourPlot[{sol2[x, y]==-10, sol2[x, y]==2, sol2[x, y]==6, 
sol2[x, y]==50}, {x, -2, 2}, {y, -2, 2}, PlotPoints —20, 
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PlotLabel— "Implicit Plot with C=-10,2,6,50"] 


Mathematica Exercises 

Turn in both the commands that you enter for the exercises below as well as 
the output/figures. These should all be in one document. Please highlight or 
clearly indicate all requested answers. Some of the questions will require you 
to modify the above Mathematica code to answer them. 


18. 


iif), 


20. 


. Enter the commands given in Mathematica Example 1 and submit both 


your input and output. 


Enter the commands given in Mathematica Example 2 and submit both 
your input and output. 


Enter the commands given in Mathematica Example 3 and submit both 
your input and output. 


Enter the commands given in Mathematica Example 4 and submit both 
your input and output. 


Find the derivative of t? + cost with respect to t. 

Find the derivative of x? + cosx with respect to x. 

Find the second derivative of t? + cost with respect to t. 
Find the second derivative of x? + cosa with respect to 2. 
Find the antiderivative of t? + cost with respect to t. 


Find the antiderivative of x? + cosx with respect to x. 


. Find the derivative of In(tz) + cos? x + sint? with respect to t. 

. Find the derivative of e“ + cos? x + sint? with respect to 2. 

. Find the antiderivative of In(tx) + cos? x + sint? with respect to t. 
. Find the antiderivative of e“ + cos? 2 + sint? with respect to 2. 

. Find the definite integral of 2? + cosx from « = 0 to x =3. 

. Find the definite integral of na from « =1 tox =5. 


. Find the definite integral of e~” from x = —1 to x = 3. Give the answer 


as a decimal. You will likely need to use N. 


sin xz 


Find the definite integral of from « = 1 to x = 10. Give the answer 


iG 
as a decimal. You will likely need to use N. 


Numerically verify that y(x) = sinw + 2cosz is a solution on (—o0, co) 


Numerically verify that yi(2) = e”, yo(x) = xe® are both solutions on 
(—00, 00) to y” — 2y’ + y =0. 
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Solve y’ = sin(x?), y(0) = 0 by hand. Then use Mathematica to find 
y(1), y(3). (Hint: remember, from Calculus, that y(a) = i f(t)dt isa 
function of x and thus y(1) is a number that can be evaluated with the 
above code.) Use Mathematica to plot the solution from x = 0 to x = 4. 
Use Mathematica to numerically solve y’ = sin(x?), y(0) = 0. Plot this 
numerical solution from « = 0 to x = 4. 

Solve y! = sus) y(1) = 0 by hand. Then use Mathematica to find 

as 

y(2), y(3). (Hint: remember, from Calculus, that y(x) = fy f(t)dt is a 
function of x and thus y(2) is a number that can be evaluated with the 
above code.) Use Mathematica to plot the solution from x = 1 to x = 6. 
Use Mathematica to numerically solve y! = sal) y(1) = 0. Plot this 


D 
numerical solution from x = 1 to 7 = 6. 


Numerically verify that y—y® +cosz+ asin z = C is an implicit solution 
to the ODE (1 — 6y°)y’ = —2 cosa. 


Solve y+ ay’ = — by hand. This solution is implicit. Choose 3 
y— 
different C-values and plot the implicit solutions. 


Consider the equation 
2 il 2 
JPEG Verity © 
in which y is an implicit function of z. Give an implicit plot of the 
equation for C = 2,4,10 for x € [—3, 3], y € [—3, 4]. 
Consider the equation 


2 2 
log —3y a —(@) 


in which y is an implicit function of x. Give an implicit plot of the 
equation for C' = .1,.5,.9 with x € [—3, 3], y € [-1, 1]. 

We will learn in a later chapter that the solution of a differential equation 
is sometimes written in the form of a series. There is a Mathematica 
procedure in Appendix A that plots the Taylor series of sinxz about x = 0 
for a given number of terms and over a given interval. Modify this code 
to show numerically that 


xv 


is the solution of y’ = y +27, y(0) = 1. Find the analytical solution of 
this ODE (either by hand or using NDSolve) and compare it to the 5-, 
6-, and 7-term expansion (1.50) over the interval [—4, 4]. 


Chapter 1 Projects 
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Project 1A: Particles in the Atmosphere 
Under normal atmospheric conditions, the density of soot particles, N(t), 
satisfies the differential equation 


= = —k,N?(t) + kaN(t) (1.51) 
where k, = a-K, and kg = agKa. K- is the coagulation constant (mea- 
sured in units of cm?/sec) and relates how well particles stick together; 
Kq is the dissociation constant (measured in molar units) and relates how 
well particles fall apart; a. > 0 and ag > 0 are the relevant conversion 
factors that permit the units to work out. Both K, and Kg depend on 
temperature, pressure, particle size, and other external forces. 

(a) Solve (1.51) using separation of variables to obtain the solution 


ekat 
NW) =7—., 
(f) ekat + C 


Ra 
where C is an arbitrary constant. 
(b) Find the value of the constant C that makes N(to) = No. The 
following table lists typical values of k. and kg. 


ie || 18a 
163 | 5 
125 | 26 
95 | 57 
49 | 85 
300 | 26 


For each pair of values in the table, sketch the graph (use a graphing cal- 
culator or computer) of N(t) if N(0) = 0.01, 0.05, 0.1, 0.5, 0.75, 1, 1.5, 
and 2. You will have five graphs with eight solution curves on each graph 
(corresponding to the eight initial values). Regardless of the initial con- 
dition, what do you notice in each case? Do pollution levels seem more 
sensitive to k. or kg? 

(c) Show that if ka > 0, then 


: ka 
ae NN ko 
Why is the assumption kg > 0 reasonable? For each pair in the table, 
calculate kag/k.. Which situation results in the highest pollution levels? 
How could the situation be changed? 
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Project 1B: Insights into Graphing 
In describing the solution of a differential equation, we use the term gen- 
eral solution for a family of solutions of the differential equation. These 
general solutions contain arbitrary constants. The term particular so- 
lution is used to discuss solutions that are free of arbitrary constants, 
usually as a result of requiring that the solution satisfy some initial con- 
dition. Sometimes a differential equation has a particular solution that 
cannot be obtained by selecting a specific value for the arbitrary constant 
in the general solution. 
(a) Using calculus show that the line 

y=mer + = 

m 

is tangent to the parabola y? = 4az for all values of m. 
(b) Show that the slope of the tangent to the parabola is given by 


dy 2a 
dx /4axr 


so that at x = -*,, the slope is m. 

(c) We know that at the point of tangency P the tangent line and the 

parabola have the same direction. Thus, they have a common value 

of dy/dx, as well as of « and y. Show that at the tangency point P, 
dy 


- dt 
and that the tangent satisfies the equation 
dy & a 
=—r+—. 
Y~ de du 
(d) Show that the differential equation 
dy a 


Una 


also holds for the parabola at P, where Han and dy/dx are the same as 
for the tangent. But, since P may be any point on the parabola, show 
that the equation of the parabola y* = 4ax must be a solution to the dif- 
ferential equation. This solution is a singular solution to the differential 
equation as it contains no arbitrary constants. 
(e) Solve the differential equation 
dy a 

y= ane + ay 
Why is the solution different than that obtained in part d? Does this 
violate the uniqueness theorem? 


Chapter 2 


Geometrical and Numerical Methods 
for First-Order Equations 


We have studied methods for solving particular types of differential equa- 
tions, but as we have seen, there are many equations for which these methods 
do not apply. In this chapter we will investigate some useful geometrical and 
computer-assisted methods for analyzing the solution of a differential equa- 
tion. 


2.1 Direction Fields—the Geometry of Differential Equa- 
tions 


It should come as no surprise that most differential equations that one 
encounters cannot be solved. For example, even when an equation is separable, 
we have seen that some of the resulting integrals may not have antiderivatives 
in terms of elementary functions. Even when we exhaust all possible methods 
for analytically solving ordinary differential equations, we will encounter just 
as many equations where those methods don’t apply. 

All is not lost, however, as graphical and numerical methods have become 
commonplace in analyzing the behavior of differential equations. We will now 
turn to graphical and numerical methods for solving the first-order differential 
equation 

o = fay), (2.1) 
at 
The numerical methods of solution that we cover in this section apply in an 
analogous way to higher-order equations and systems of equations. 

We will begin our study of the geometry of differential equations by again 
considering (2.1) and assuming for now that solutions exist and are unique 
in some rectangle {(z,y)|a < « < b, c< y < d}. Suppose that yi(z) is a 
known solution to (2.1) on this rectangle. What does this mean? Recall that 
a solution gives us an identity when substituted into the differential equation. 


Thus, 
Wt) _ Fe, (0) (2.2) 


on this rectangle. Let us take a closer look at (2.2). The left-hand side of 
this equation is simply the derivative of the solution and this derivative is 
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given by the right-hand side. But it really didn’t take much work to evaluate 
the right-hand side. In fact, given any pair of values in the rectangle, say 
(xo, yo), we could find the slope of the solution that passes through that point 
in the x-y plane by simply evaluating f(xo, yo). And we could do this for each 
point in this rectangle. Thus, we can calculate the slope of any solution curve 
without actually knowing an explicit solution. 

The implications of this last statement are profound: given an initial condi- 
tion, we can trace out solution curves without having to know the analytical 
solution. We can choose a grid of points in the x-y plane and evaluate the 
slope of the solution at each of these points. We draw a short line segment in 
the plane at that point with the calculated slope. The collection of these line 
segments is called the slope field or direction field. In many examples, the 
slope of the solution may be the same along a given curve. If we let (a, y) be 
the points on this curve, then 


Any member of the family of curves that satisfies this equation is called an 
isocline, which means a curve along which the inclination of the tangents is 
the same. The use of isoclines is extremely useful if we are sketching a direc- 
tion field by hand. We will illustrate their use in the first example and leave it 
to the reader to check their use in the others. Let us consider a simple example. 


| Example 1 | Draw the direction field for the equation 


dy _ 
dx” 


and sketch the solution curve in this direction field that passes through the 
point (0, 1). 


Solution 

We draw a representation of the direction field by selecting a grid of points 
and drawing a short tangent line at each point. The slope of each tangent line 
is determined by evaluating the right-hand side of our differential equation 
at the given point. This is very time consuming but is easily done on the 
computer. Equipped with the computer-generated direction field, we should 
be able to check that each point (x, y) in the plane has the slope on the graph, 
as determined by substituting particular values into the right-hand side of the 
given differential equation. In particular, we observe that the isoclines are 
given by y = k, i.e., by horizontal lines at the y-value of k. For example, all 
the line segments along y = 1 have a slope of 1 and all the line segments along 
y = —2 have a slope of —2. A direction field that only depends on y and not 
x is called autonomous and will be discussed in detail in later sections. The 


direction field for oy = y is shown in Figure 2.1a. 
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(a) 
FIGURE 2.1: The direction field for oe = y is shown in (a). The graph of 


y(x) through the point (0,1) on the direction field for ou = y is shown in (b). 


Using the condition that y(x) passes through the point (0,1), we can sketch 
the solution of y(x) on the direction field by following the line segments in 
the direction field of Figure 2.la. The sketch of the graph of y(a) is shown in 
Figure 2.1b. 

Notice how the solution passes tangentially through the direction field. 
That is, each line segment is tangent to the solution in the direction field. 
Now, of course, we could have easily calculated the solution to 


dy _ 


0)=1 
We y(0) 


as y(x) = e” and we should observe that this is the curve plotted. Let’s try 
this method again for an equation for which we didn’t know the solution. 


| Example 2| Draw the direction field for the equation 


and sketch several solution curves that pass through the direction field. 


Solution 

The direction field for 4 = x? + y? is shown in Figure 2.2a. The reader 
should check a few pairs of points on the graph to make sure the direction 
field is correct, e.g., check the pairs (3,0) and (0, $). One could also observe 
that the isoclines are given by x? + y? = k which are circles of radius Vk, 
which indicate that the line segments have the same slope along any circle 
in the x-y plane. On this direction field, we can plot several graphs of y(x), 
shown in Figure 2.2b. 
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(a) 
FIGURE 2.2: The direction field for 44 = 2? + y? is shown in (a). Graphs 
of several solutions y(a) on the direction field for ou = x7 + y? are shown in 


(b). 


We note two points that should be obvious: 

1. The finer the mesh of the grid for the representation of the slope field, the 
better the approximate solution curve which we are able to draw. This is the 
same as saying the tangent line is a good approximation to a curve close to 
the point of tangency. And the more points we have the better we can sketch 
this approximation. 

2. Drawing a direction field by hand is tedious—it is best to use a computer. 
It is, however, essential that we check a few points of the direction field 
(generated by the computer) by hand. As much as we would like computers 
to always give us the answers we want, this will never be the case. 


Problems 

Without solving the equations and without using the computer, match each 
differential equation in Problems 1—4 and 5-8 with the graph of its direction 
field shown here. 


dy x+1 dy 3 
1.—= 2.—= 1 1 
dx y+l1 da (2° +1)@* +1) 
3 dy _ yeti A dy _ 1 
‘dx x41 ‘dx (a3 +1)(y3 +1) 
dy dy 
5. 5 = u(x’ —y) 6. 7 = a(x" —y) 
dy _ >) 2 dy _ x 
7.4 UY) ae pee 
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(a) 
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Sketch the direction field for each of the first-order differential equations given 
in Problems 9-25. (Get clarification from your instructor as to whether you 
should obtain these direction fields by hand or from the computer.) Verify 
that the direction fields you obtain in problems 10-12 are autonomous by ob- 


FIGURE 2.4: Direction fields for Problems 5-8. 
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serving that the slopes of the line segments are constant along fixed y-values. 
For each problem, use your sketch to draw various solution curves. Then draw 
the solution curve that passes through the given initial condition. 


dy _ dy 4 dy, 
9. ae =cosy, (0,0) 10. de =y, (1,1) 11. de =siny, (0,0.1) 
12.4% —e-¥, (0,1) 18.4% =cosz, (0,0) 14. %=24, (1,1) 
ys. Yo» y 
a 1) 16, = ie 17.2 = 
5 da sinz, (0,—1) 16 da e”, (0,1) de xty, (0,0) 
Yy Y a? Y 2 
18. = 1.4 19. = 1 0. = 1 1 
8. 7. aaa (11) ree (0, 1) dnt a ), (0,1) 
x 72 
21.y' = 22. y' = y(y? —2 1) 23. y/ = —— 
ra |, (0, 0) y' =y(y° — 2), (0,1) 23. y PHT (0, 0) 
ey ed) 


2.2 Existence and Uniqueness for First-Order Equations 


We have now seen some approaches for gaining insight into the solution of 
an ordinary differential equation. Before going further we address the issue 
of when we can expect solutions to even exist or, if they exist, to be unique. 
This will become essential as we further develop numerical solution methods. 

We begin with an example based on two direction fields that look very 
similar. 


| Example 1 | Consider the direction fields for the differential equations 


y/ = 3y4/3 and y! = 2y2/3 


(given in Figure 2.5), together with the initial condition (3, —1). 
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(a) 
FIGURE 2.5: Direction fields for (a) y’ = 3y*/3 and (b) y! = 2y?/°. 
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The reader should attempt to sketch the corresponding solution curve. It 
is not obvious that one of the solution curves passes through y = 0 while the 
other does not. The problem with passing through y = 0 is that y = 0 is itself 
a constant solution for both of the differential equations. The point where 
the two solutions intersect is a point where the solutions are not unique. In 
other words, if we start at the initial condition (henceforth IC) where they 
intersect, we cannot be sure which solution curve we should follow. We can 
see this more explicitly by solving the two equations, which easily can be done 
since both are separable equations. The differential equation 


= =| 
y’ = 3y*/9 with IC y (=) = —1 has solution y= ——_, 
: (x +3) 


while 
-3 2." 
y! = 2y?/> with IC y (=) = —1 has solution y = € s) : 


The first of these approaches zero as x gets large and the second passes through 
(0,0); see Figure 2.6. 
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J f/lALSS SS JL flo L SAA LLL 
/f fi Lif ft fee S// LLLNS, LS LS 
f/f f 7? Fife f fe fel PLL LF LE F GF 
f}] fd ft bb ET del // f/f AS LS SL ST 
(a) (b) 


FIGURE 2.6: Direction fields for (a) y! = 3y*/> with IC y(=) = -1, 
which stays in bottom half plane and (b) y! = 2y?/? with IC y (=3) = -1, 
which passes through upper half plane. 


Thus, it appears that we do not have any problems with uniqueness of so- 
lutions in y’ = 3y*/3, but we do have a problem with uniqueness of solutions 


in y' = 2y?/8 or at least we do at the point (0,0). i 


There are two things we need to be aware of at this point. The first is the 
need for a way of checking whether we can expect solutions to exist and be 
unique at a given initial condition. The other involves how to best calculate a 
numerical approximation to the solution of a differential equation—we trusted 
the computer to accurately sketch a solution curve in the previous section but 
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how can we be sure that it will not overlook the slight differences between 
two direction fields? We will save our discussion of the latter until the next 
chapter and will only address the former for now. In order to understand the 
types of initial value problems that yield a unique solution the following result 
is required. 


THEOREM 2.2.1 Existence and Uniqueness 


Consider the initial-value problem 
y = f(x,y) with y(xo) = yo. 
If f and Of /Oy are continuous functions on the rectangular region 
KIG<KReh ExXu<d 
containing the point (9, yo), then there exists an interval 
|v —xo| <h 


centered at xp on which there exists one and only one solution to the 
differential equation that satisfies the initial condition. 


The proof of this theorem will be omitted, as it will take us off course. If you 

are interested, it can be found in C. Corduneanu’s Principles of Differential 
and Integral Equations (13). 
Remark: If the condition that Of /Oy is continuous on the rectangular region 
R containing the point (0, yo) is not included in the assumptions of the theo- 
rem, then we say that at least one solution exists. We call this more “relaxed” 
result an existence theorem because the uniqueness of the solution is not 
guaranteed. 


| Example 2 | Solve the differential equation 


dy _« 
dx sy 


with the initial condition y(0) = 0. Does this result contradict the Existence 
and Uniqueness theorem? 


Solution 
The equation is separable and thus easily can be solved. Rewriting the equa- 
tion 
ydy = xda, 
integration yields the family of solutions 


y?—-a2?=C. 
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Application of the initial condition gives us C = 0, so that 
y—2’ =0. 
Solving for y gives two solutions 
y=a and y=-a. 


Does this result contradict the Existence and Uniqueness theorem? Although 
more than one solution satisfies this initial-value problem, the Existence and 
Uniqueness theorem is not contradicted because the function x/y is not con- 
tinuous at the point (0,0). The requirements of the theorem are not met at 
the place where uniqueness is violated. 


|_| 
| Example 3 | Verify that the initial-value problem 
dy _ 
dx # 


with the initial condition y(0) = 1 has a unique solution. 


Solution 
In this problem, 


f(x,y) = Y, % = 0, and Yo= i 


Hence, both f and Of /Oy are continuous on all rectangular regions containing 
the point 
(20, Yo) = (0,1). 


By the Existence and Uniqueness Theorem, there exists a unique solution to 
the differential equation that satisfies the initial condition y(0) = 1. We verify 
this by solving the initial-value problem. 

The equation is separable and equivalent to 


OY ge 
y 


A general solution is given by y = ce* and with the initial condition y(0) = 1 
gives 
y=e. 

a 

The Existence and Uniqueness theorem gives sufficient, but not necessary, 
conditions for the existence of a unique solution of an initial-value problem. 
That is, there may be differential equations that do not satisfy the theorem 
but have solutions that are all unique. 


90 Chapter 2. First-Order Geometrical and Numerical Methods 


| Example 4 | Consider the initial-value problem 


dys x 


dz yp/8 


with y(0) = 0. The Existence and Uniqueness theorem does not guarantee the 
existence of a solution because xy~?/? is discontinuous at (0,0). The equation 
is separable and has solution 


1 
=50 te 


5 3/5 
y= G +e) . 


Using the initial condition gives the unique solution 


3 
ve 
6 = 


The theorem only provides sufficient conditions for a unique solution to 
exist. It does not say a unique solution won’t exist if the conditions are not 
satisfied. 


| Example 5 | Consider the initial-value problem 


dy _ 
“de 7 


5 
3 


Oo w 


y 


so that 


with y(0) = 0. We can rewrite this as 
dy _y 


dx x 


We see that f(x,y) = y/x and thus Of /Oy = 1/x. The Existence and Unique- 
ness theorem does not guarantee the existence of a solution because f(x, y) is 
not continuous at the point (0,0). 

The equation is separable and we can calculate the solution as 


y= Cea. 


Now, the initial condition y(0) = 0 gives the identity 0 = 0, which means 
that y = Cx is a solution to the differential equation for any value of C. Thus, 
there are infinitely many solutions to the initial-value problem; see Figure 2.7. 
Hence, the solution of the initial-value problem is not unique. 
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FIGURE 2.7: Direction fields for ou = a Note that all the solutions 


shown here satisfy the initial condition y(0) = 0. 


Problems 

In Problems 1-6 determine whether the Existence and Uniqueness theorem 
guarantees a unique solution to the following initial-value problems on some 
interval. Explain. 


i Hy gt ay, y(0) =0 2.y=a?—y?’, (0) =1 
Ho 
d 

a, ate ay, y(0) =0 4.y/=alny, y(1)=1 
By 
dy 1 dy 

5.5 =o+>—> 90) et ee) 


In Problems 7-14 determine the region(s) of the a-y plane where solutions 
(i) exist and also where solutions (ii) exist and are unique, according to the 
Existence and Uniqueness theorem. 


d 
ie qe = 3a(y+ - 8. ia a 
: ae _ 10. de = _ 
— a ae 
i= (c+y)? 14.8 ay?! 


In Problems 15-20, consider the given initial-value problem. (i) Use the Ex- 
istence and Uniqueness theorem to determine if solutions will exist and be 
unique. (ii) Solve the initial-value problem to obtain an analytic solution. 
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Use this analytic solution to determine whether solution(s) passing through 
the given IC will be unique. 


15. % =5(y — 2)9/5, y(0) =2 16. = 4, y(1) =0 
17. # = dy1/?, y(1) =3,y >0 18. = 2/3(1—y?), y(0) =1 
19. % = 3(y—1)¥3, y(0) =1 20. 4 = S25, y(0) =1 
21. According to the Existence and Uniqueness theorem, the initial-value 
problem 
oY ly 
dx 


with y(1) = 0 has a solution. Must this solution be unique? Solve this 
equation by considering two cases, y > 0 and y < 0, and using separation 
of variables. Is the solution unique? 


2.3 First-Order Autonomous Equations—Geometrical 
Insight 


We will now consider a method of geometrical analysis of differential equa- 
tions to solve autonomous first-order equations. 


Definition 2.3.1 


A first-order differential equation of the form 


a) (2.3) 


is called autonomous when f does not depend explicitly on the indepen- 
dent variable x. 


We develop an important method of analyzing a differential equation to 
determine its behavior without solving it. It is recommended that the reader 
be very familiar with the review material in Section 2.8.1 on quickly graphing 
factored polynomials. 

We first note that any first-order autonomous equation is separable and can 


thus be rewritten as 
dy / d 
—_— = x. 
f(y) 


The integral on the left, however, is often not a simple integral. Our reason 
for needing to evaluate the integral was our desire to find the explicit (or 
implicit) solution, thereby allowing us to plot solutions in the 2-y plane. For 
autonomous equations, however, we will gain insight into our solution in a 
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qualitative manner. We will still be able to sketch solutions in the x-y plane 
but will lose the ability to answer a question such as “given the initial condi- 
tion of y(0) = 1, what is the value of the solution at 2 = 3?” Our “qualitative 
description” means that we will be able to describe the long-term behavior of 
the solutions even though we will not write an explicit or implicit formula for 
the solution; that is, we will be able to answer the question “given the initial 
condition of y(0) = 1, what is the value of the solution as x — co?” 


The Phase Line 


Our goal is to be able to predict the solution curve of the differential equation 

given in (2.3). We will gain an understanding of the behavior of the solution 
by observing that the expression ou is the rate of change of y with respect to 
x. 


Definition 2.3.2 


An equilibrium solution of the autonomous equation y' (a) = f(y) is any 
constant, y = C, that is a solution of the differential equation. 


By inspection, we see that a) = 0 for any constant so that an equilibrium 
Hb 


solution,’ y*, satisfies f(y*) = 0. When oy > 0, y is increasing; and when 


dy < 0, y is decreasing. We can say these are qualitatively different behaviors 
of the solution. Thus for (2.3) we can say whether the solution y is increasing 
or decreasing simply based on the sign of f(y). 


| Example 1 | Consider the exponential differential equation 


4 =ry. (2.4) 
The equation is separable with solution y = Ce’, where C is determined by 
the initial condition. We could plot these solutions but instead we want to use 
our “qualitative approach.” To do so, we observe that the right-hand side is 
simply a straight line whose slope depends on r. There are two qualitatively 
different cases: r > 0 (exponential growth) and r < 0 (exponential decay). 
The horizontal axis is the y-axis and the vertical axis represents ay. see Fig- 
ure 2.8. When r > 0, the derivative is always positive for y > 0, implying 
that the solution y is increasing. This is indicated by an arrow pointing to 
the right on the y-axis, with right being the direction of increase in y. In 
the other case, the arrow points to the left because the derivative is always 


negative. The y-axis with the equilibria and corresponding arrows drawn on 


1We note that some books refer to equilibrium solutions as critical points because they 


satisfy the calculus definition dy = 0. We will plot solutions in the y plane and a 


dx 
“critical point” of the graph in this plane is not the same as the equilibrium solutions we 


are focusing on here. Thus, we will refer to y-values that satisfy du = 0 as equilibria. 
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it is called the phase line and contains the essential information necessary to 
describe the long-term behavior of the solution, i.e., what is lim;-... y(x) for 
a given initial condition y(ao) = yo. More can be said although it does not 
show in the arrows. In the first diagram, the derivative function is growing, 
which indicates not only that y is growing, but it is growing more and more 
rapidly. 


ry ry 


FIGURE 2.8: Phase line diagrams for Equation (2.4). 


dy 


We said that an equilibrium solution, y*, corresponds to 7% = 0 and we 
thus have one equilibrium at y* = 0. If our initial condition is on the equilib- 
rium solution, e.g., y(0) = 0, then we will always remain at that equilibrium 
solution. For a general equilibrium, y*, we state this as 

lim y(a) = y* for the initial condition y(a%) = y*. 
xwLZ—oo 
Note that y still depends on x (even though there is no x that is seen in the 
picture!) and the arrows indicate what happens to y as a increases. 

It is natural for us to ask what happens to the solution of a differential 
equation as it proceeds from an initial condition close to an equilibrium so- 
lution. We will still consider the differential equation of Example 1 to gain 
insight into this. We will first examine the direction field for the two distinct 
cases, r > 0 and r < 0; see Figure 2.9. The unique feature about the direction 
field of an autonomous equation is that the equilibrium solution is represented 
by a horizontal line at the value y*. Solutions starting near this horizontal 
line will either approach it or diverge away from it. 

If we consider (a) corresponding to r > 0, we see that if we start with an 
initial value yo = 0, we will always stay at y = 0. If we start with an initial 
y-value yo > 0, our solutions will go to oo, while if we start with an initial y- 
value yo < 0, our solutions will go to —oo. Thus, starting anywhere other than 
the equilibrium solution will yield a solution that diverges away from y* = 0. 
We summarize the behavior near the equilibrium solution with a convenient 
definition. For convenience of notation, we will denote the derivative as y/ 
instead of as ou 
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FIGURE 2.9: The y-y’ direction field for au = ry. In (a), we have r > 0 
and in (b) we have r < 0. 


Definition 2.3.3 

Consider the autonomous differential equation y’ = f(y), where y = y(z). 
Assume that y* is an equilibrium solution. Then 

1. y* is said to be asymptotically stable if all solutions with an open 
set of initial conditions close by it approach y* as x — oo. 

2. y* is said to be stable if all solutions with an open set of initial 
conditions close by it always remain close by (but do not necessarily 
approach it) as 7 — oo. 

3. y* is said to be unstable if it is not stable. 


Note that every equilibrium solution that is asymptotically stable is also 
stable. We should also note that the equilibrium solution always corresponds 
to horizontal line segments in the direction field. Thus, a quick inspection of 
a direction field can tell us whether or not it corresponds to an autonomous 
equation. 


Relating this definition to our previous example, we see that the equilibrium 
solution y* = 0 is unstable if r > 0 because solutions with an initial condition 
close by y* do not remain close by. When r < 0, however, solutions starting 
close by y* approach it and thus y* = 0 is asymptotically stable. 


Our definition of stability can be put in terms of the traditional ¢-d defini- 
tions used in calculus. Specifically, y* is stable if, for each € > 0, there exists 
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a 6 > 0 such that 
|y(a) — y*| < € whenever |yo — y*| < 6 for all x > 0, 


where yo is the initial y-value. 

Remark: In the case of a first-order autonomous equation, we can have an 
equilibrium solution that is half-stable. In this case, it is stable from one 
side but unstable from the other. A simple example is y/ = y? where initial 
conditions to the left of y = 0 approach y = 0, whereas initial conditions to 
the right of y = 0 go to oo. 


What was the purpose of using the phase line if we ultimately plotted 
the direction field and concluded information about the stability of y*? We 
actually did not need the direction field to reach the conclusions that we did— 
everything was already contained in the phase line. Specifically, the arrows on 
the line were drawn because they described how the solution was changing. In 
the case of r > 0, any solution starting with an initial condition to the right 
of y* = 0 increased (as a increased) and thus moved away from y*, whereas 
any solution starting with an initial condition to the left of y* = 0 decreased 
(as x increased) and thus moved away from y*. We can think of the arrows as 
pushing the solution in a given direction. On both sides of y* = 0, the arrows 
are pushing the solution away and thus we classify y* as unstable. For r < 0, it 
is the opposite situation and we see that the arrows are pointing toward y* = 0 
from both sides, thus indicating that solutions approach y* as x increases. In 
this case, we consider y* = 0 an asymptotically stable equilibrium solution. 
We can also sketch the solutions in the x-y plane without knowledge of the 
direction field. The information contained in the phase line is sufficient to 
sketch qualitatively accurate solutions. 

By examining the phase line, we have the ability to explain what happens 
to the solution as « —>+ oo. As mentioned earlier, this description is a qual- 
itative one—we cannot answer the question “given that y(1) = —2, what is 
y(8)?” Giving a quantitative answer to this question would require having 
the explicit or implicit solution, which may or may not be an easy solution 
to obtain. Using the phase line, we can also still give a plot of the solu- 
tions in the a-y plane but we again lose our ability to describe the value of 
the solution at a particular z-value. The usefulness of the phase line is in its 
ability to quickly give us qualitative information about any solution as x > oo. 


| Example 2 | Consider the autonomous equation 
y =y?(L—y’). (2.5) 


Find the equilibria. Draw the corresponding phase line diagram and use it to 
determine the stability of the equilibrium solutions. Use the information con- 
tained in the phase line to sketch solutions in the x-y plane. Then conclude 
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the long-term behavior for any initial condition. 


Solution 

To determine the equilibria, we set y’ = 0 and solve for y. This gives us 
equilibria of y = 0,—1,1, where y = 0 is a double root. The highest power 
and corresponding coefficient is —y* and thus we can use the information from 
Appendix B to quickly sketch the curve in the y-y’ plane (see Figure 2.10). 
To draw the arrows on the phase line, we simply need to observe where the 
derivative y’ is positive vs. negative. Between the equilibria y* = —1 and 
y* = 0 as well as between y* = 0 and y* = 1, we see that y’ > 0 because the 
curve is above the horizontal axis. Thus we draw arrows going to the right to 
indicate an increase in the solution value. To the left of y* = —1 and to the 
right of y* = 1, we see that y’ < 0 because the curve is below the horizontal 
axis and thus we draw arrows going to the left. 


(b) 
FIGURE 2.10: View of (2.5) in the (a) y-y’ plane and (b) phase line. 


Examining the phase line from the y-y’ plane (see Figure 2.10), we see that 
the arrows on both sides of y* = —1 are pointing away from it and it is thus 
unstable. The arrows on both sides of y* = 1 are pointing toward it and it 
is thus asymptotically stable. For y* = 0, we observe that arrows to the left 
of it point toward it but arrows to the right of it point away from it. Thus 
y* = 0 is half-stable. 

To sketch solutions in the 2-y plane (see Figure 2.11), we first draw the 
equilibrium solutions as horizontal lines. We next note that solutions will 
always be unique and thus we will never be able to cross these equilibrium 
solutions. If we begin with the initial condition yo < —1, the arrows on the 
phase line indicate that solutions will go to —oco as x + oo. We thus draw 
curves in the xz-y plane that go away from the line y = —1. If the initial 
condition satisfies —1 < yo < 0, the arrows on the phase line indicate that we 
will approach the equilibrium solution y* = 0. We thus draw curves in the x-y 
plane that go away from y = —1 and toward y = 0. Because the value of y/’ is 
small near the equilibria, the slope of the corresponding solution curve in the 
z-y plane will be small. Thus as « — —oo, the solution will have y = —1 as 
a horizontal asymptote, whereas when x — oo the solution will have y = 0 as 
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its horizontal asymptote. We can follow similar reasoning to draw solutions 
that begin with initial condition 0 < yo < 1 and y > 1. 


y=1 
y=0 x 
y=-l 


FIGURE 2.11: Sketch of some solutions of (2.5), based exclusively on 
phase line information; phase line (on left) from Figure 2.10 is now drawn 
vertically for easier comparison. 


Equipped with the above information, we can now answer the final ques- 
tion of this example. Mathematically, we want to know lim,-,. y(x) for any 
given y(2o) = yo. This would be a very challenging task if we had the explicit 
solution in front of us. With the phase line, however, we simply need to de- 
scribe what happens to solutions with initial conditions between equilibrium 
solutions. 

(i) if yo < —1, then y(a) + —o0 as > co 

(ii) if —1 < yo < 0, then y(a) + 0 as a 4 00 

(iii) if 0 < yo < 1, then y(#) — las x + co 
( 


iv) if yo > 1, then y(x) > 1 as > co = 


It is this type of “qualitative description” and knowledge of the “long-term 
behavior” that we are able to gain from considering the phase line instead of 
the explicit solution. Depending on the situation you may be considering, one 
of these approaches may be more desirable than the other. 


Stability of Equilibrium via Taylor Series 

Up to this point, our description of the equilibrium solutions has been based 
on insight gained from the phase line. Although this has been useful, it is often 
desirable to have an analytical method for determining stability of equilibria. 
This will be completely independent of the graphical interpretation we just 
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learned but we will see that a combination of both methods will often be 
useful in analyzing a given problem. 
Recall that the Taylor series expansion of f(y) near y* is given by 


Fy) =F) FF WOW) + FL WU + GLOW y-V Pt 

, , (2.6) 

Taylor series are often useful in approximating the value of a function near a 

point y* by only considering a finite number of terms of the Taylor series. In 

some situations, we are able to gain very good approximations with only the 
first two or three terms in the expansion. 

We now expand the right-hand side of our autonomous equation in a Taylor 
series about the equilibrium solution, y*: 


y=fy)+hYWy-y)t-:. 


How has this helped us? We first observe that f(y*) = 0 because y* is an 
equilibrium solution. Then we observe that for y-values very close to y*, the 
terms (y — y*)?, (y — y*)3, etc. are small compared to f’(y*)(y — y*). Thus, 
close by the equilibrium y*, we see that 


y = fy )(y-y") (2.7) 


is a good approximation. But this differential equation is separable and we 
know the solution is an exponential function. Moreover, the behavior of the 
solution will depend only on the sign of f’(y). We can summarize this result 
in a useful theorem. 


THEOREM 2.3.1 
Consider the autonomous differential equation y’ = f(y), with equilibrium 
solution y*. If f has a Taylor expansion about y*, then 
(a) y* is stable when f’(y*) < 0 and 
(b) y* is unstable when f’(y*) > 0. 


Note 1: In (a), the condition f’(y*) < 0 says that the graph in the y-y’ plane 
decreases through the horizontal axis, whereas in (b), the condition f’(y*) > 0 
says that the graph in the y-y’ plane increases through the horizontal axis. 
Note 2: The stability of y* cannot be determined by this theorem in the 
case when f’(y*) = 0. In this situation, the stability of y* is determined by 
the higher-order terms of the Taylor expansion. We would need to use other 
means, e.g., the phase line, in order to conclude anything about the stability 
of the equilibrium. 


| Example 3 | Find the equilibrium solutions of the autonomous equation 


y’ = y*(1—y?). Use Theorem 2.3.1 to determine their stability. 
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Solution 

We see the equilibria are y = —1,0,1. Our function is f(y) = y?(1 — y?) = 
y’ —y* and the derivative is f’(y) = 2y—4y?. Applying the previous theorem 
shows that 

(i) f’(-1) = 2(-1) — 4(-1)? =2>0 y* = —1 is unstable 

(ii) f’(1) = 2(1) — 4(1)? = -2 < 0 => y* = 1 is stable 

(iii) f’(0) = 2(0) — 4(0)? = 0 => stability of y* = 0 is inconclusive. In order 
to determine the stability of y* = 0, we could use the graphical method of 
Example 2 to find that it is half-stable. 


2.3.1 Graphing Factored Polynomials 


We give a brief reminder on how to graph factored polynomials quickly. We 
will not be concerned with maxima, minima, inflection points, etc. Instead we 
care only about whether a graph is positive or negative between roots, how 
it passes through a root, and its behavior for large x-values. Knowing how to 
graph these quickly will be especially helpful in Sections 2.3-2.4, which deal 
with first-order autonomous equations and their applications. 

We will assume that we begin with a polynomial P(«) in the form 


agx*° (a,x — b1)*! (aga — bz)*? «++ (ana — bn)*" (ema™ + +++," +9)*4, (2.8) 


where the a;, b;, c; are real numbers and where the last factor c¢,,”" +--+ cya+ 
Cp is assumed to be a polynomial with no real roots. That is, it does not factor 
any further over the field of real numbers. Note that cma +--+c,x+cp9 might 
be able to be factored as a product of quadratic factors but since our concern 
will be with the term with the highest power and it leading coefficient, we will 
leave it in this expanded form. For example, it could be written as 


(a? +1)(a? +6)? 
or it could be written out as 
a® + 130% + 4807 + 36. 


The latter form matches the final factor in (2.8). To be a bit more explicit, 
we are requiring 


aj #0, 1=0,1,2,...n, Ci F 0; cp #0: 


The roots of (2.8) are given by 
Oe ons ee 
r= — with rAr; if if), (2.9) 
i 
and each root r; occurs k; times where k; > 0 is a nonnegative integer. For 
the agz* factor, we should observe that bo = 0. 
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In order to sketch the curve, we need to know how many times each root 
occurs (its multiplicity), the highest power in the polynomial P(x) given in 
(2.8), and the sign of the coefficient of this highest power. The roots are given 
by (2.9). For the last two needed items, we multiply the terms with highest 
power of x from each factor. That is, we consider 


agx*° (a,z)™ (arr) *? a (que) (ena (2.10) 
which can be simplified slightly as 
ag (ai) (an)? <5 (ay) ey ee Oe are Age (2.11) 


where 


A = ao(a1)"!(az)*? «++ (@n)**(em)** and K = ko thi tke +-+++kn +mkg. 
(2.12) 
With the knowledge of A, K, and the roots (and their multiplicity), we can 
sketch the curve with the two charts seen in Figure 2.12. 
We finish this brief review with two examples. 


eT Sketch the polynomial 


P(z) = (x — 1)7(2+ 32)(4— 2)? (2 +2). 


Solution 

We see that the polynomial has the following roots and multiplicities: 
root x=1 | x=-2/3 | x=4 | x=-2 
multiplicity | 2 1 3 1 


Calculating the highest power and its coefficient gives 
(x)? (32)(—2)?(x) = —3a". 


We are in the case K odd and A < 0 and we can identify the long term 
behavior from Figure 2.12. To find the behavior near the roots, we go from 
left to right. The first root we encounter is « = —2 and it occurs once. Since 
we are coming from above, we must pass through the root as in la of Fig- 
ure 2.12(b). The second root we encounter is 7 = —2/3 and it occurs once. 
Since we are coming from below, we must pass through it as in 1b of Figure 
2.12(b). The next root we encounter is x = 1 and it occurs twice. Since we 
are coming from above, we must pass through it as in 2b. The final root is 
x = 4 and it occurs 3 times. Since we are now coming from above, we must 
pass through it as in 3a of Figure 2.12(b). Note that we can match up with 
the long term behavior for large positive x. A sketch is given in Figure 2.13. 
Note that for these rough sketches, we do not care about the relative max- 
ima, etc. Our goal is to know when the graph is positive versus negative and 
how it passes through the roots. Thus, we will not draw a scale on the Y-AXiS 
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behavior 


| ! in this 

‘oe ee 
Kk odd region determined 

determined by roots 


by roots 


(a) 


behavior 
in this 
in this region 
region determined 
determined by roots 
by roots 


K even behavior 


# of times shape of curve through root 
root occurs 


ines ae - eae, 


even 


odd>1 -_ . of . 


FIGURE 2.12: (a) Behavior of factored polynomial (2.8) for large |x|. The 
curves obey lim;-,—-. P(x) and limz_,.. P(x). (b) Behavior near the roots of 
factored polynomial (2.8). 


(b) 


| Example 5 | Sketch the polynomial 


P(x) = —23 (a2? — 4)(a — 1)(5 — )(3 + 3a)(4 — 2)? (x? +1). 


Solution 
Noting that (x? — 4) factors into (a + 2)(a — 2), we see that this polynomial 
has the following roots and multiplicities: 
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FIGURE 2.13: Sketch of P(x) = (a — 1)?(2+ 32)(4— x)? (a + 2). 


root x=0 | x=2 | x=-2 | x=1 | x=5 | x=-1 
multiplicity | 3 3 1 1 1 1 


Calculating the highest power and its coefficient gives 


—@" (a”)(x)(—x) (3x)(—22)"* (2?) = +122. 


We are in the case kK even and A > 0 and we can identify the long term 
behavior from Figure 2.12. To find the behavior near the roots, we go from 
left to right. The first root we encounter is 7 = —2. It occurs only once and 
since we are coming from above, we must pass through it as in la of Figure 
2.12. The next root we encounter is 2 = —1. We are now coming from below 
and because it occurs once, we pass through it as in lb. The next root is 
x = 0 and it occurs three times. Thus we pass through it as in 3a of Figure 
2.12. The next root is x = 1 and it occurs once. Since we are now coming 
from below we pass through it as in 1b. The next root is # = 2 which occurs 
three times. We are now coming from above and thus pass through it as in 
3a. The final root is x = 5 and occurs only once. Thus we pass through as in 
1b. Note that we can match up with the long term behavior for large positive 
x. A sketch is given in Figure 2.14. 


FIGURE 2.14: Sketch of P(x) = —x3(a? — 4)(x — 1)(5 — x)(3 + 32) (4 — 
2x)? (x? +1). 
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2.3.2 Bifurcations of Equilibria 


Often we have a situation where the stability of a given equilibrium solution 
depends on the value of a parameter. We saw this in the first example when we 
considered y’ = ry. In this case, r was the parameter and we saw that y* = 0 
was stable when r < 0, whereas y* = 0 was unstable when r > 0. Thus chang- 
ing the r-value changes the stability of the equilibrium solution. We could also 
have a change in the number of equilibria and we state the following definition: 


Definition 2.3.4 

Consider the equation y’ = f(r,y), where f is an infinitely differentiable 
function and r is a parameter. A bifurcation is a qualitative change in 
the number or stability of equilibrium solutions for this equation. 


There are three bifurcations that we will consider: transcritical, saddle- 
node, and pitchfork. We will give examples of the first two and will leave the 
third as an exercise. 


| Example 6 | (Transcritical Bifurcation) 


Consider the equation 
y=ry-y, (2.13) 


where r € R. The equilibria are y* = 0,r and, since r may change, we consider 
the three cases: r < 0, r = 0, and r > 0. We could check the stability 
analytically using the Taylor series method previously discussed. However, it 
is more instructive to see the change in the stability of the solutions with the 
phase line; see Figure 2.15. 


r<@0 P= r>0o0 


FIGURE 2.15: Phase line view of a transcritical bifurcation. The bifurca- 
tion happens at the value r = 0 but we determine the type of bifurcation by 
observing what happens before (for r < 0) and after (for r > 0). 


We first note that y* = 0 is always an equilibrium solution. When r < 0, 
there is another equilibrium solution at y* = r, lying to the left of y* = 0. 
Drawing arrows on the phase line, we see that y* = r is unstable and y* = 0 
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is stable. As r increases, the non-zero equilibrium approaches y* = 0. At the 
bifurcation value of r = 0, the equilibrium solution y* = 0 is a double root 
and is half-stable. As r becomes positive, the non-zero equilibrium solution 
is now to the right of y* = 0. Drawing arrows on the phase line, we see that 
y* =0 is now unstable and y* = r is stable. 

This bifurcation is known as a transcritical bifurcation. It is usually 
easiest to think of in terms of the parameter r. When r is negative, we have 
two equilibrium solutions; as r continues to increase, the solutions approach 
each other and “crash” into each other when r = 0, switching stability as they 
do so; for r > 0, the solution y* = 0 is now the unstable one and y* = r is 
the stable one. We stated early in this example that there were three cases to 
examine (before, at, and after the bifurcation) and we finish by noting that 
sometimes we may not be able to figure the qualitative situations without first 


doing a bit of work. 
|| 


| Example 7| (Saddlenode Bifurcation) 


Consider the equation 


yl =r—y?, (2.14) 


where r € R. The equilibria are y* = +,/7, which exist when r > 0. We again 
have three cases to consider: r < 0, r = 0, and r > 0. When r < 0, there 
are no equilibrium solutions. Drawing arrows on the phase line, we see that 
any initial condition gives a solution that diverges to —oo. When r = 0, an 
equilibrium solution appears at y* = 0 and is half-stable. Solutions beginning 
with an initial condition yo < 0 go to —oo, whereas an initial condition yo > 0 
gives a solution that approaches 0. When r > 0, there are now two equilibria. 
Drawing arrows on the phase line shows that the equilibria at y* = —,/r is 
unstable and y* = ,/7r is stable; see Figure 2.16. 

y! y' 7 


r<0 r=0 r>0 


FIGURE 2.16: Phase line view of a saddlenode bifurcation. The bifurca- 
tion happens at the value r = 0 but we determine the type of bifurcation by 
observing what happens before (for r < 0) and after (for r > 0). 
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This bifurcation is known as a saddlenode bifurcation and we again 
think of it in terms of the parameter r. When r is negative, we have no equi- 
librium solutions; as r continues to increase, an equilibrium solution appears 
on the phase line, seemingly out of nowhere and is half-stable. For r > 0, this 
equilibrium then breaks into two parts, an unstable and a stable equlibaum 


It is sometimes useful to plot the equilibrium solutions versus the parameter. 
We call this a bifurcation diagram and these are shown in Figure 2.17. 


“=r 
stable 


y* = 0 stable y* = 0 unstable 
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ie) 0 


(a) r (b) r 
FIGURE 2.17: (a) Transcritical bifurcation diagram. Equilibria curves 
obtained from Figure 2.15. (b) Saddlenode bifurcation diagram. Equilibria 
curves obtained from Figure 2.16. 


In both of these examples, we were able to vary the one parameter r in 
order to observe the bifurcation. We thus say that there was a one pa- 
rameter family associated with this bifurcation. We can also have two 
parameters present and both can change to give these bifurcations. In these 
cases, we would say that we have a two parameter family that gives us 
the bifurcations. However, we could always perform various substitutions to 
rewrite the equation so that only one parameter is really needed in each of 
the bifurcations. Because of this, we refer to the transcritical and saddlenode 
bifurcations as being of co-dimension 1. The two types of pitchfork bifur- 
cations that are explored in the Problems are also co-dimension 1 bifurcations. 


Problems 

For Problems 1-20, (i) sketch the differential equation in the y-y’ plane by 
hand. (ii) Draw the phase line diagram, clearly stating the location and 
stability of the equilibria. (iii) State the long-term behavior for all initial 
conditions. (iv) Assuming y = y(a), sketch the corresponding graph in the 
traditional «-y plane. 
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i = 2y+3 20 = re 3.y =y? -—y-6 
4. y= y(y+2)(y—3) 5. y= y? +4y +4 6.4 =-y? 

Ty =y'(2—-y) 8.y/ = (y—1)?(y—2)21 + y) 

9.y' =(y—2)3(y2-9) 10.y'=cosy+1, —247<y< 27 

11. y’ =siny, —27<y< 27 


For the next two problems, assume that v = v(t). Continue with parts (i)-(iv) 
from the previous problems but note that (i) will be in the v-v’ and (iv) will 
be in the t-v plane. The equations were discussed in detail in Section 1.4 as 
they are used to model the motion of a free-falling object. If u(t) represents 
velocity, interpret the stability of the resulting equilibria. 

12. v' =g—+4v 13.0! =g-—4v 


For the next seven problems, continue with (i)-(iv) but assume that x = x(t). 
Note that (i) will be sketched in the x-a’ plane and (iv) will be sketched in 
the t-a plane. 

14. 2’ = (2 —2)9(x? +4) 15. 2’ = (2—2)3 (x? + 4)? 

16. 2! = —2?(4— x)(9 — x”) 17. 2’ =2°(1—2)(1—2?) 

18.2 =2(4—3)(1+23)\(1—27)? 9 19.2’ = x7(1— 22)3(x? — 1) 

20. 2’ = x°(x? + 5)(x — 4)?(a2 + 5) 


Use the analytic approach of Theorem 2.3.1 to determine the stability of the 
equilibria in Problems 21-24. 

21.y’=y?-1 22.y'=1-y7? 

23.y =y2 +1 24. y’ = -y 


In Problems 25-27, let the parameter r vary and determine the bifurcation 
that occurs by drawing the two qualitatively different phase line portraits. 
State the stability of the equilibria for both pictures. Draw the bifurcation 
diagram as well. 

25.y’=r+y? 26.y/ =1—-r+y’? 27.y' =ryt+y? 


28. A pitchfork bifurcation occurs when two equilibria appear out of one and 
change the stability of the existing equilibria as they appear; three equi- 
libria are present after the bifurcation has occurred. Draw the phase line 
view of the following two bifurcations (before, at, and after the bifurca- 
tion). Then draw the bifurcation diagram. 

(a) y’ = ry — y° (supercritical pitchfork bifurcation) 

(b) y’ =ry+y? (subcritical pitchfork bifurcation) 

For both types of pitchfork bifurcations, you will need to consider the 
three different cases r < 0, r=0, and r > 0. 


29. Consider the autonomous equation y’ = f(y) and suppose it is known 
that f’(y*) = 0, f’(y*) = 0, f(y*) <0 for the equilibrium solution y*. 
Can we conclude anything about the stability of this solution? 
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2.4 Modeling in Population Biology 


The autonomous equations of the previous section have application in the 
area of population modeling. We can derive some important equations by 
thinking of the per capita rate of change of a population. We will let x(t) 
denote the given population. The rate of change is simply the derivative with 
respect to time and the per capita rate of change is then given by 


We have considered the simplest model of population growth, where we as- 
sume the per capita rate of change is constant and is equal to some parame- 
ter 7: 

1 da 

xdt 7 
Rearranging this gives the familiar exponential growth differential equation 
that we have seen before: x’ = rx. The assumption that the rate of change is 
constant is not usually realistic for large populations. Why? Think of bacteria 
growing in a petri dish with finite space and nutrients with which to grow. 
When the population is small, the exponential growth model is acceptable, 
but when limited space and resources become an issue, the assumptions of 
this model break down. A more accurate model arises if we assume a linear 
decrease in the per capita rate of change of the population. This basically 
says that the more bacteria there are, the less quickly the overall population 
will grow due to limited resources. If there are too many bacteria, the overall 
population level may not change or may even decrease. The equation can be 
written 


1 dz 
eae =r—ky,a, 


which we will rewrite as 


where K = r/k,. This is known as the logistic differential equation. For 
small populations, we note that the logistic equation is approximated well by 
the exponential model. To see this, observe that if x is much smaller than K, 
then ~ is very small and the rx(1 — 4) term is approximately rx. Thus for 
small x, the differential equation is approximately ue = ra. For the logistic 
equation, we can conclude that if x(t) is small relative to K, then x(t) exhibits 
nearly exponential growth. When x(t) is near K, it levels out to be nearly 
constant. The behavior in-between is harder to predict, but it would seem 
reasonable that there is a smooth transition from exponential growth to no 
growth. If « is greater than K, the results are similar except the derivative 
is negative, so x(t) starts off decaying exponentially until it nears K where it 
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levels out. These behaviors are illustrated in Figure 2.18(a) and we sketched 
these solution curves without explicitly calculating the solution! 


~~ i Xx) 


0 x 


(a) 
FIGURE 2.18: (a) Qualitative behavior of the solutions to the logistic 
equation. (b) Phase line for the logistic equation. 


The constant r gives the intrinsic rate of growth of the population and the 
constant K is called the carrying capacity since, if x represents a population, 
the population rises or decays until it reaches this level. This can easily be 
seen with the corresponding phase line given in Figure 2.18(b). If we start 
with an initial condition xo in the interval (0, A), then the solution x(t) will 
approach K as t + oo; if we start with an initial condition 79 > K, then 
x(t) will again approach K as t > oo; if the initial condition satisfies 7p < 0 
(biologically meaningless but okay mathematically), then «(t) will approach 
—oo as t > oo. As mentioned earlier, we can also observe that the larger the 
magnitude of f(a), the larger the change in the solution. Thus, the solution 
changes most rapidly at the value K/2. The change is very small near the 
equilibria. 

Since linear and exponential models are solved readily, one does not need to 
resort to the phase line to analyze the behavior of their solutions. However, 
the use of phase line analysis in these cases gives a quick illustration of the 
behavior of solutions in the long run. With the quadratic or logistic model, 
the value of the phase line analysis method becomes clear. 

Again considering the logistic model, we could have solved it as a separable 
equation using the technique of partial fractions in an intermediate step (or 
as a Bernoulli equation) . The solution can be understood by looking at it in 
the right way. But the qualitative analysis provided here gives us a way to 
quickly describe the long-term behavior of the solution for any initial x-value 
(i.e., any initial condition). In particular, we can readily see that any initial 
population between 0 and K will grow. In terms of modeling, this is actually 
a weakness in the logistic model. It suggests that a non-zero population, no 
matter how small, will result in growth. There are several resolutions to this 
problem. One is to put restrictions on the range of model validity. One might 
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say that this model holds only for populations above the size of, say, 100. 
On the other hand, one might want a model that tends toward zero if the 
population gets too small. One such model is an Allee effect model. 

An Allee effect model is an improvement over the logistic model in that 
if a population gets too small the growth rate becomes negative. For small 
population or large population, we thus have the per capita growth rate being 
negative and we can write 


1 

a =r(a—x2)(a—b), 
where b > a > 0. This is used to handle a number of complex processes that 
occur with small populations, such as difficulties finding mates or inbreeding 
effects, without complicating an otherwise simple model. The Allee effect 
model is also the next natural step in our progression for it involves ee with 
a cubic equation. 


f(x)=rx(a-x) (x-b) fix)=rx(a-x) (x-b) 


(a) (b) 


FIGURE 2.19: (a) Cubic from Allee effect model. (b) Phase line dia- 
gram for Allee effect model. 


An Allee effect model is a cubic whose graph is given in Figure 2.19. The 
most useful forms to see this cubic equation are in the form a = ra(a—2z)(a— 
b), r>0, b>a>0, which is useful if the equilibria x = a, x = b are known, 
and in the form 42 = x(r— a(x — b)*) (where the constants r,a, would need 
to be chosen appropriately in either case to give the desired cubic shape). A 
typical Allee effect growth curve and phase line are presented in Figure 2.19. 
There are three equilibria: one corresponding to the carrying capacity, one 
corresponding to zero population, and one at the threshold between “large” 
and “small” population sizes. With this model, both the zero population 
and the carrying capacity are stable equilibria, which generally corresponds 
to intuition. The “large-small” threshold point is an unstable equilibrium. 
Populations that start out above this value tend toward the carrying capacity; 
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populations below this point tend to extinction. 

We again note that the differential equation for the Allee effect model is 
separable and the resulting integral would involve partial fractions. Our qual- 
itative phase line analysis was much quicker. We have now worked through 
analysis of three specific cases: linear, quadratic, and cubic. From this foun- 
dation, generalizations to other functions are obvious. A very nice discussion 
of population models with polynomial growth rates can be found in the tech- 
nical report by Bewernick et al. [7]. 


| Example 1, Consider a population that is governed by the Allee model with 


a carrying capacity of 20, a minimum threshold population of 5, and an intrin- 
sic growth rate of 2. Write this differential equation and analyze its stability. 


Solution 
If we let N be the population, then comparing with the Allee model we see 
that r = 2, a= 5, b = 20 so that 


dN 
a = 2N(5- N)(N — 20). 


The equilibrium solutions are N* = 0,5,20. Analyzing stability either on the 
phase line or by examining f’(N*), we see that N* = 0 is stable, N* = 5 is 


unstable, and N* = 20 is stable. = 


2.4.1 Nondimensionalization 


In applications, it is often the case that parameters will arise in your model. 
As was seen in the previous section, changes in these parameters can often 
result in bifurcations in the system. It is quite often the case that it is not 
simply one parameter that can be changed but multiple parameters that can 
be changed. One way to simplify analytical and numerical computation that 
may be involved is to nondimensionalize the equations. In doing so, we 
rewrite the system in a form without units and often can group parameters 
together in such a way that it is easier to see the ones that are really affecting 
the system. 


| Example 2) Consider the logistic equation with constant effort harvesting, 


which will be derived in the next subsection: 
dN N 
—=rN(|(1-—)-AN, 


where N is the population, r its intrinsic growth rate, K the carrying capacity, 
and H the coefficient of harvesting. 
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We define a new population variable x and a new time variable r: 
L=— T==. (2.15) 


We note that x will be a dimensionless (i.e., without units) population if A 
has units of population and 7 will be dimensionless time if T has units of time. 
We substitute for N and ¢t in the ODE. On the left-hand side, we obtain 


dN d(zA)dr_ ,dxel_ A, 
di o6dr tO a TOOT’ 


(2.16) 


where ’ denotes the derivative with respect to 7. On the right-hand side, we 
obtain 


r(x A) (1 - =) —H(xA)=A fra (1 = aa) = He| (2.17) 


Substituting both into the ODE then yields 


a =A ra (1 = ran - He] , (2.18) 


from which we immediately see that the A cancels from out front of both 
sides. Multiplying by T’ gives 


x 


_ =; ——_— 
x =rer (1 K/A 


) — AT. (2.19) 
At this point, we pause to see if we can make convenient choices for A and T 
that will simplify things for us. The rule of thumb is usually to start with the 
innermost functions, work your way out, and then lump remaining parameters 
together. Proceeding in this fashion, we choose A = K as that will simplify 
the parentheses. The two choices we have remaining are to set T = 4 or 
LS 7 Both are equally correct but in finding bifurcations by hand, it’s 
probably best to choose the former since graphing a line will be easier. Thus, 
we set T = 4 and h = HT = a. We note that indeed the units of A are 
population and the units of T are time so that « and 7 are dimensionless. 
Our equivalent ODE is then 


xv =a(1—2) —he. (2.20) 


Mathematically, we see that this equation, with its lone parameter h, will be 
much easier to analyze than the original formulation with three parameters. 
We note that x is a parameter that is now scaled to the carrying capacity and 


T is scaled to the intrinsic growth rate of the population. = 
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For the general situation, let n be the order of the ODE or the number of 
first-order equations of a system of ODEs. In nondimensionalizing either of 
these, we introduce n new dimensionless variables and one new dimensionless 
time variable. We proceed as above and will be able to at least eliminate n+1 
parameters. Sometimes the problem is structured so that we can eliminate 
more than that. If we start out with less than n+1 parameters, it will depend 
on the structure of the equation as to how “nice” we can make things look. 


Harvesting 


The example we considered in our nondimensionalization was a modification 
of the logistic equation under what we called constant effort harvesting. 
Let’s go back to our formulation of the logistic equation in terms of per capita 
growth: 


where N > 0, r,K > 0. We consider a model of a fishery in which fish 
are harvested (i.e., caught) at a rate that is proportional to their population 
size, which is also referred to as constant effort harvesting. To model this, 
we substract off a constant H from this equation to denote the per capita 
removal rate: 


Multiplying by N gives the familiar equation 


ON xg (1 = z) _HN. (2.21) 
dt K 


We want to be able to understand the long-term behavior of the solutions. 
However, in its present form (2.21) has 3 parameters and this can be difficult 


to analyze. Luckily, as we saw previously, we can nondimensionalize this and 
obtain an ODE with equivalent dynamics 


ze’ =2(1—2)—ha, 
where x > 0, h > 0. To find equilibrium solutions, we set x’ = 0 and obtain 
x(l—2z)—ha =0, which factors as a(l-h-z)=0. 


We thus see that the equilibria are x = 0,1 —h. Because the biological appli- 
cation requires x > 0, we observe that for increasing values of h, our system 
goes from having 2 equilibria to 1 equilibria. If we ignored the biological re- 
striction of x > 0 and considered the mathematical version x € R, then we 
see that we go from 2 equilibria to 1 equilibrium (when h = 1) to 2 equilibria. 
Thus, our system has likely undergone a transcritical bifurcation. To check 
the stability, we set f(a) = x(1 — x) — ha and evaluate f’(x"*): 


f'(z) =1-h—22 => f'(0)=1-h and fid-h)=h-1. 
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For h < 1 we see that «* = 0 is unstable and x* = 1—h is stable, while for h > 
1 we see that x* = 0 is stable and «* = 1 —h is unstable (and not biologically 
relevant). Our system did indeed undergo a transcritical bifurcation. 

e e e e e e e e e e e e 


Problems 


1. Consider the equation 
x =2z"(1—z), 


where x > 0 represents a population. 

(a) Determine the equilibria and their stability. Do the stability results 
differ from the logistic equation? 

(b) Compare the growth rate of the two models for small x. 


2. Consider the Allee model 
aa =Ma-#\(e-d) 


with r = 2,a = 1,b =6. Determine the equilibria and their stability. 
3. Consider the Allee model 


xv’ =ra(a—x)(x—b), 


with r= 1,a = 2,b = 10. Determine the equilibria and their stability. 


4. Consider the equation 
a’ =2"(2—2)(c— 7), 


where x > 0 represents a population. 

(a) Determine the equilibria and their stability. Do the stability results 
differ from an equation with the Allee effect? 

(b) Compare the growth rate of the two models for small x. 


5. Consider the equation 
zg =a7(1—2)(z—4), 


where x > 0 represents a population. 

(a) Determine the equilibria and their stability. Do the stability results 
differ from an equation with the Allee effect? 

(b) Compare the growth rate of the two models for small x. 


6. When is the exponential population model appropriate? When is the 
logistic population model appropriate? When is an Allee model appro- 
priate? Discuss the benefits of each of these models and their drawbacks. 
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7. Suppose that a certain harmful bacteria, once introduced into the body, 


10. 


always persists. The body’s immune system is usually able to keep the 
levels of the bacteria low unless the level of bacteria introduced is initially 
too large. We thus consider the equation 


x’ = x(x —a)(x—5), 


where x > 0 represents the population of this harmful bacteria and 0 < 
a <5 is a parameter. 

(a) Determine the equilibria and their stability. 

(b) Describe what happens to the bacteria for any initial condition. (You 
will have two cases to consider.) 

(c) Give a biological interpretation of the parameter a. In particular, 
determine whether a healthy person is likely to have a larger or smaller 
a-value than an unhealthy person. Are there other factors that may 
change the a-value? 


. Suppose a certain harmful bacteria is governed by the equation 


a’ = ¢(10 — x)[(z — 5)? —al, 


where x > 0 represents the population of this harmful bacteria and a < 25 
is a parameter (a can also be negative). Suppose that a bacteria level 
x > 8 represents a lethal level (and the person thus dies). 

(a) Determine the equilibria and their stability when a > 0. 

(b) Determine the equilibria and their stability when a = 0. 

(c) Determine the equilibria and their stability when a < 0. 

(d) What type of bifurcation did the system undergo? 

(e) What is the biological significance of going from a > 0 to a < 0? Does 
the patient survive this change in the parameter? 

(f) Give possible biological factors that may influence the value of the 
parameter a. 


. Write a differential equation describing a population of bacteria that has 


each of the following characteristics: 

(i) Below a level x = 1, the bacteria will die off. 

(ii) If the initial level of bacteria satisfies 1 < ao < 10, the body is able 
to keep the bacteria at the “safe” level of « = 6. 

(iii) If the initial level of bacteria satisfies 2 > 10, then the number of 
bacteria grows without bound. 


Write a differential equation describing a population of bacteria that has 
each of the following characteristics: 

(i) Below a level 7 = 1/2, the bacteria will die off. 

(ii) If the initial level of bacteria satisfies 1 < 1% < 8, the body is able to 
keep the bacteria at the “safe” level of x = 2. 

(iii) If the initial level of bacteria satisfies x > 8, then the number of 
bacteria grows without bound. 
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11. 


12. 


13. 


14. 


15. 


Suppose that the per capita growth rate (x’/ax) of a certain population is 
described by the polynomial 


a(2—2)*(2 — 4). 
(a) Write the corresponding differential equation. 
(b) Determine the equilibria and their stability. 


Suppose that the per capita growth rate (x’/x) of a certain population is 
described by the polynomial 


r(a—a)(a—1), ra>0. 


(a) Write the corresponding differential equation. 

(b) Determine the equilibria and their stability. You will have three cases 
to consider (a < 1l,a=1,a> 1). 

(c) Give a biological interpretation for what happens to the population 
levels for each of your answers in part b. 

Show that the logistic equation 


aa (1-Z) 
dt K 


can be written in dimensionless form as 
dx 
dt 


for suitable choices of x and rT. 


= 2(1-2) 


Another harvesting model that we could consider takes the form 
dN 1 N AHN 
K B+N 


for N > 0, R,H,B > 0. Show that this can be written in dimensionless 


form as 
dx haz 


b+a 


A well-known model of a biochemical switch (see [48] and references 
therein) is 

dg k3g? 

“4 — kg, — k eee 

dt 180 — Kg + tg 
where g is the concentration of gene product (e.g., mRNA) and k; > 0 
are constant. Show that this can be written in dimensionless form as 

dx x? 


dr 9 TER 


We note that this is one of the “lucky” situations where we began with 
5 parameters and our dimensionless equation only had 2 parameters. 
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16. Consider the harvesting model in Problem 14: 
dN N HN 
— =RN{1-—} - —— 
dt ( Kk ) B+N 


for N >0, R,H,B>0. 

(a) Give a biological interpretation of this type of harvesting. In partic- 
ular, explain what happens for small and large NV. 

(b) Now consider the dimensionless form 


dx hz 
b+a 


Show that the system has 1, or 2 biologically relevant equilibrium solu- 
tions depending on h, b. Classify their stability. 


2.5 Numerical Approximation: Euler and Runge-Kutta 
Methods 


In this section we will consider two methods for numerically approximating 
solutions to ordinary differential equations. While Euler’s Method is straight- 
forward and easy to understand, it suffers from the fact that errors accumulate 
quickly! A modification of it is the 4th order Runge-Kutta method and we 
will see that errors accumulate much slower for a comparable number of com- 
putations. 


Euler’s Method 
We will now consider Euler’s method, the first of two methods of numerically 


solving a differential equation of the form 


dy = 
dx — f(y): 


In examining direction fields, we observed that solutions must pass through 
the field tangentially. A natural goal is to want the computer to somehow 
sketch the solution curves. There are numerous methods for solving differen- 
tial equations, some explicit and some implicit. We can choose methods that 
will give us as much accuracy as we want; however, the greater the accuracy 
desired, the more the computational work involved. As mentioned, we high- 
light two explicit methods here and leave an implicit method for the exercises. 
As we will soon see, Euler’s method is a simple-to-understand method and 
turns out to be very unreliable. It does, however, give us insight into the sec- 
ond method we will consider—the Runge-Kutta method, which is widely used 
in practical applications due to its balance of computational work vs. accuracy. 
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Extremely important note: At this point we caution the reader about 
the potential pitfalls of computing numerical solutions. There is not a single 
method that will always work. Some methods have a wider applicability than 
others; some are easier to work with than others; all of the methods will run 
into difficulties for specialized problems. The reader should always view a 
graphical and/or numerical output with a bit of skepticism. Even if no other 
approach seems to work, the reader should attempt some type of calculation 
or analysis to make sure the solution behaves as it is expected. The best 
advice we can offer is don’t blindly trust your computer output. You should 
always be able to justify why the computer output is a believable answer. 


The Method 
The first method is essentially an algorithm that formalizes the method of so- 
lution we used to draw a direction field. The method is an old one, essentially 
due to Euler. 

Here is how it works. Pick an initial value, say y(0) = a. Compute the 
equation of the tangent line at this point, namely, 


yo(a) =a+ f(0,a)a. 


This approximate solution is good for very small changes. Euler’s method is 
sensitive and tends to diverge away from a good approximation. We specify 
the step size, h, which tells the algorithm how far to go before recomputing 
a tangent line. In essence we are choosing a mesh size that is uniform on the 
z-axis but not the y-axis. The next equation of a tangent line is 


yi(z) = yo(h) + f(h, yo(h))h. 


The process is continued until the last desired x-value is reached. The 
smaller the h-value, the smaller we expect the error to be and the more cal- 
culations we require to reach the specified value of x. Usually when Euler’s 
method is used the equations of the lines are not written; rather the se- 
ries of points that the lines connect is given. The coordinates of each point 
Vig. = 2 +h =29 + th are calculated by the Euler method formula: 


Yi+1 =y thf(xi,yi), t= 0,152). 60.4 (2.22) 


Note that the value y;;1 is an approximation to the true solution. We obvi- 
ously want the two to be as close together as possible. See Figure 2.20 for a 
graphical interpretation of (2.22). 

To generate these approximate solutions, we apply the following algorithm: 


1. Specify (x0, Yo), h 
2. Divide the interval along the z-axis by the step size h to obtain the 


total number of steps n and a sequence of z-values: x; = 29 + th, with 
t= 0;,1,,.2,3) 2.3% 


2.5. Numerical Approx: Euler and Runge-Kutta Methods 119 


Euler step: y, ,,=y,+ hf &,, y,) 
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exact solution 


FIGURE 2.20: One step of Euler’s method. Given the point (2;, y;), the 
next y-value is calculated by yj41 = yi + hf (x;, y;). Note that no information 
regarding the function on the interval (#;,2; + h] is used to calculate the 
approximation at x; +h. 


3. For each x;, calculate the next approximate solution value yj41 = yi + 
hf (xi; yi) 


Euler’s method is easy to implement on a spreadsheet, calculator, or with any 
programming language geared toward mathematical computations. 


| Example 1 | Use Euler’s method with h = 0.1 to approximate the solution 


of 
dy _ 
dx 
with y(0) = 1 on 0 < x < 1. Determine the exact solution and compare the 
results. 


Ly 


Solution 
Since au = ry we have f(a,y) = xy. The initial condition y(0) = 1 says that 
zo = 0 and yo = 1 so with h = 0.1 we have 
Ly =% +h=0.1, 2 =% + 2h = 0.2, aan) L190 = To + 10h = 1.0. 
Euler’s formula (2.22) applied to this example becomes 
Yit1 = Yi + (0.1)(ai) (Mi). 


We calculate y1 as 


yi = yo + (-1)(a0)(yo) = 1+ (-1)(0)C) = 1. 
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We then use x; and the newly found y; to calculate yo: 
yo = yi + (.1)(a1)(y1) = 1+ (-1)(.1)() = 1.01. 


Since we are solving the equation on the interval 0 < w < 1, we need to carry 
out these calculations until 7; = 1, that is, eight additional times. The results 
are summarized in the table in Figure 2.21. 


Xi Yi vi Yi 

0.0 1.0 0.6 | 1.15873 
0.1 1.0 0.7 | 1.22825 
0.2 1.01 0.8 | 1.381423 
0.3 | 1.0302 | 0.9 | 1.41937 
0.4 | 1.06111 || 1.0 | 1.54711 
0.5 | 1.10355 


FIGURE 2.21: Euler’s method with h = 0.1 for the equation ou = ry. 


d 
The closed form solution to as = xy with the condition y(0) = 1 is found, 


using separation of variables, to be 


y(“) = ae, 
(Give it a try!) The table in Figure 2.22 compares the values using Euler’s 
method and the exact solution. We see that initially the approximation is 
good, but its accuracy declines as x increases. A smaller step size h would 
increase the accuracy of the approximation but, as mentioned earlier, requires 
more steps. 

Figure 2.23 shows the graph of y(x) = er /2 plotted together with the ten 
points from Euler’s method from Figure 2.22. - 


There are many methods that are considered superior for accuracy to Eu- 
ler’s method, but Euler’s method has the advantage of simplicity, intuition, 
and clarity. Regarding the accuracy, the table in Figure 2.22 compared the 
approximate answer via Euler’s method vs. the exact method. In general, we 
can place a bound on this difference, known as the local truncation error, 
by saying that 

lyi — y(as)| < Ch, 


where C is a constant that depends on the function and the specified interval. 
See, for example, Burden and Faires [10]. It is also an important method to 
understand because when h = 1, it treats differential equations as difference 
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x; | Euler y; | Exact y(a;) | Error |y; — y(2i)| 
0.0 1.0 1.0 0 
0.1 1.0 1.0050 0.005 
0.2 1.01 1.0202 0.0102 
0.3 | 1.0302 1.0460 0.0158 
0.4 | 1.06111 1.08329 0.02218 
0.5 | 1.10355 1.13315 0.02960 
0.6 | 1.15873 1.19722 0.03849 
0.7 | 1.22825 1.27762 0.04937 
0.8 | 1.31423 1.37713 0.06290 
0.9 | 1.41937 1.49930 0.07993 
1.0 | 1.54711 1.64872 0.10161 


FIGURE 2.22: Euler’s method with h = 0.1 compared with the exact 


solution for the equation ou = xy. 


Y 
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FIGURE 2.23: Plot of y(x) = e® /? with points obtained via Euler’s 
method. 


equations. (Differential equations depend on a continuous independent vari- 
able, whereas difference equations depend on a discrete independent variable. 
As an example, difference equations can be used to model an insect population 
in which the adults lay eggs and die before the young hatch—the indepen- 
dent variable is the generation of the population.) In particular, we can use a 
numerical differential equation solver to give numerical solutions to difference 
equations provided we specify that Euler’s method be used and that a step 
size h = 1 is always used. See, for example, Martelli [34]. 


Runge-Kutta Method 


We have just employed Euler’s method for solving a first-order differential 
equation. There are many other methods. Two that are frequently encoun- 
tered are second-order and fourth-order Runge-Kutta methods. The method 
was named after the German mathematicians Carl Runge (1856-1927) and 
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Wilhelm Kutta (1867-1944), who developed the theory long before the advent 
of modern computers. These work in manners similar to Euler’s method ex- 
cept that instead of using first-order approximations (lines), they use second- 
order (parabolas) and fourth-order (quartics) curves, although they do it in 
ways that avoid the computation of higher-order derivatives. The Runge- 
Kutta methods can also be interpreted as multiple applications of Euler’s 
method at intermediate values, that is, between x; and x; +h. It is this 
interpretation that we will use for graphical purposes. 

The algorithms are more complicated than Euler’s but, nevertheless, are 
easily enough programmed. We will consider the Runge-Kutta fourth-order 
algorithm which is by far the method most commonly used by scientists and 
engineers in their respective fields. The idea is to use a weighted average of the 
slopes of field segments at four points “near” the current point (x;, y;). The 
location of each slope evaluation is determined by an application of Euler’s 
method. 

In order to figure out a good formula for giving weights to the function value 
at the four points we assume we have computed y;, which is the approximation 
to y(a;). In order to compute the next approximate solution value y;+1, we 
observe that the fundamental theorem of calculus gives 


Litl vith 
y(i41) — y(ai) = | y (x)dx = i; y' (x)dx. (2:93) 


a a 


We then use Simpson’s rule to obtain an approximation to this integral: 


u(esrn) ~ ule) » 5 [ued + ay! (00+ 5) +f ean]. 


We said that we want to use a weighted average of the slopes at four points 
“near” the current point. We obtain a fourth point by performing two evalu- 
ations at the middle point x; + A. Thus our approximation is rewritten 


ufc) ~ ulus) » 5 |p es) +20! (e+ 5) +20 (w+ 3) tule) 
(2.24) 
and we will update the slope at the successive evaluations. 

In order to see the evaluations at the four points, we give a graphical in- 
terpretation of the Runge-Kutta fourth-order method and then state the for- 
mula for calculating the next approximate value, yj41. See Figure 2.24 for 
the graphical interpretation. We begin at the point (x;, y;) and calculate the 
coordinates of the next point of the approximate solution (#41, yi+1)- 


1. First evaluation k, = f(2;, y;) 

We calculate the slope of the solution that passes through our current value 
(x;,yi) by evaluating f(a;,y;). Call this slope ky. 

Preparation for 2nd evaluation: Euler’s method tells us to continue at 
this slope for one step size and the Euler approximation of the next value is 
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Ist evaluation: k= f'(x,, y,) 2nd evaluation: k,= f (x,+4 +399; +5) 
Preparation for 2nd evaluation Preparation for 3rd svalaniion 


exact solution exact solution 


3rd evaluation: k= f (x,+4,y,+%) 4th evaluation: k,= f (x, +h, Y; +hk, ) 
Preparation for 4th evaluation 


exact solution exact solution 


FIGURE 2.24: One step of fourth-order Runge-Kutta. Given the point 
(x;, yi), the next y-value is calculated by yj41 = yi th(ki +2ho + 2h3 +h) /6. 
The graph here is shown for a solution that is increasing and concave down 
on the interval (x;, 7; +h). 


(a; +h, y; + hk1). The Runge-Kutta method takes half of this increase in the 
y-coordinate, which is easily seen to be hk, /2, and goes to the z-value halfway 
between x; and the next step x; +h. 


2. Second evaluation kz = f(x; + B. Yi t+ AR ) 

We now perform our first of a “mid-value” calculations. Our “mid-value” 
a-value is the halfway point x; +4 and the y-value is y; + + ue ; we oe the 
slope of the solution passing igen this point, which is f cm A Vit Pky), 
For simplicity, call this value ko. 

Preparation for 3rd evaluation: If we followed this slope for one step 
size (to the a-value x; + 3h) we would be at the y-value y; + wee +hkz. We 
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again take half of this increase, which is seen to be hk2/2. We go back to the 
“mid-value” a-value and a different y-value, y; + Ake | 


3. Third evaluation kz = f(x; + a Ue a) 
We now perform our second of two “mid-value” calculations. Our “mid-value” 
hke. 


x-value is still the halfway point x; + ~ and the y-value is now y; + 757; we 


again evaluate the slope of the solution passing through this point, which is 
f(ait A Yi + Ako) For simplicity, call this value k3. 

Preparation for 4th evaluation: If we followed this slope for one step 
size (to the a-value 2; + 3h) we would be at the y-value y; + Be + hk3. We 
note the increase, which is seen to be hk3. We now go to the z-value x; +h 


and the y-value y; +hk3, which takes into account this last estimated increase. 


4, Fourth evaluation ky = f(x; +h, y; + hks3) 

We now do our final evaluation at this point by calculating the slope of the 
solution which passes through the value (x; +h, y; + hkg3). Call this slope k4 
and note that the x- and y-coordinates in this evaluation were not the original 
one predicted by Euler’s method. 


We thus have four slopes close by our current (x;,y;) pair: one at x;, one 
at x; +h, and two at a; + A The Runge-Kutta fourth-order method takes a 
weighted average of these slopes to calculate the next point: 


h 
Yis1 = Yet raul + 2kg + 2k3 + ka). (2.25) 


As with the Euler method, we can put a bound on the error between the exact 
solution value y(x;) and the approximate value calculated by the Runge-Kutta 
method. The local truncation error, which is simply this difference, satisfies 


lyi — y(wi)| < Mh4 


where M is a constant that depends on the function and the specified interval. 
For a more detailed explanation, see Burden and Faires [10]. 
We summarize the above in the following algorithm: 


1. Specify (xo, yo), h 

2. Divide the interval along the z-axis by the step size h to obtain the 
total number of steps n and a sequence of z-values: 7; = % +ih, i= 
0,1,2,3,..., 

3. For each «;, calculate k;;, 7 = 1,2,3,4 (where the additional subscript 
will be used to denote the calculation from the ith value), defined by 
a. Kyi = f(©i, 9) 
b. ko 4 = f(a a h/2, yi + (hk1,;)/2) 
d. kai = f(ai +h, yi + hk.) 

4. Calculate yjiz1 = yi + h(kiy + 2ko; + 2k3,, + k4i)/6, which is the next 
y-value of the approximate solution, as calculated by the fourth-order 
Runge-Kutta method. 
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| Example 2| We will now use the Runge-Kutta algorithm with h = 0.1 to 


approximate the solution of 
dy 
a 
with y(0) = 1 on 0 < a < 1. This is the same equation we approximated 
using Euler’s method. 


ty 


Solution 
The initial condition y(0) = 1 means 2p = 0, yo = 1, so with h = 0.1 we have 


ko = f(0,1) =0, 
koo = f (0 + 0.05, 1 + (0.1) (5)) = 0.05, 


0.05 
k3o =f (0 + 0.05, 1 + (0.1) (S*)) = 0.0501, 
kao = f(0 +0.1,1 + (0.1)(0.0501)) = 0.1005, 


and thus the next value is 


0.1 
yi =1+ (=) (0 + 2(0.05) + 2(0.0501) + 0.1005) = 1.005012. 
The remaining calculations are performed similarly and are summarized in 
the table in Figure 2.25 along with the true solution. Note the close agreement 


of the Runge-Kutta approximate solution with the true value of yn. 


x; | Runge-Kutta y; | True y(a;) | Error |y; — y(2;)| 
0.0 1.0 1.0 0.0 
0.1 1.0050125 1.0050125 0.0000000 
0.2 1.0202013 1.0202013 0.0000000 
0.3 1.0460279 1.0460279 0.0000000 
0.4 1.0832871 1.0832872 0.0000000 
0.5 1.1331485 1.1331484 0.0000001 
0.6 1.1972174 1.1972173 0.0000001 
0.7 1.2776213 1.2776213 0.0000000 
0.8 1.3771278 1.3771277 0.0000001 
0.9 1.4993025 1.4993024 0.0000001 
1.0 1.6487213 1.6487210 0.0000003 


FIGURE 2.25: Runge-Kutta’s method with h = 0.1 compared with the 
2 
analytic solution (e* /?) for the equation ou = ry. 
It is often better to have closed-form solutions as they may provide the- 


oretical insights, and there are no problems with errors associated with ap- 
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proximate methods. Unfortunately most of the differential equations one en- 
counters cannot be solved. Numerical solvers allow us to proceed with our 
analysis, but are limited in that one must explicitly express all parameters as 
numbers and give all necessary initial conditions. 

e e e e e e e e e e e e 


Problems 


In Problems 1-6, let h = 0.1 and approximate the solutions to y(a#1) and 
y(x2) by hand using (a) Euler’s Method and (b) the fourth-order Runge- 
Kutta method. Then compare the results with the given explicit solution at 
x, and x2. It will be easiest if you display the results as we did in the table 
of Figure 2.25. 


1. y =2°, y(1) =1; explicit solution: y = a(a" + 3) 
2. y' =—y?, y(0) = 1; explicit solution: y = 4; 
3. y’ =a*y, y(1) =1; explicit solution: y = e(2-1)/5 
1 
A. y’ =—-y? 0) = 1; explicit solution: y = —_¥— 
y y°-cosz, y(0) = 1; explicit solution: y ee 


5. y! = 82, y(r) = 2; explicit solution: y = (12 —4cosx)!/4 


6. y’ =ye—*, y(0) =1; explicit solution: y = exp(1 — e~”) 


In Problems 7-12, solve with your computer software package using (a) Eu- 
ler’s Method and (b) the fourth-order Runge-Kutta method with h = 0.1 


to find approximate values for y(x1),y(x2),y(x3),y(@4), y(@s), y(te), y(X7), 
and y(ag). Then compare the results with the given explicit solution at 


U1, 02,3, 04,05, 06, U7, and rs. 
7. y' =e7", y(0) = 2; explicit solution: y = In(« + e?) 
2 
24 ao 
9. y/=y+cosz, y(0) =0; explicit solution: y = }(sin x — cosx +e”) 


8. y’ =—axy”, y(0) =1; explicit solution: y = 


10. y' =y+sinz, y(0) = 2; explicit solution: y = 4(cosz + sin x — 5e”) 


11. y =ax+y, y(0) =0; explicit solution: y= —x —1+e* 
12. y =(x+1)(y?+1), y(0) =0; explicit solution: y = tan(}2? + 2) 


In Problems 13-17, use MATLAB, Maple, or Mathematica and the fourth- 
order Runge-Kutta method with h = 0.01 to plot the numerical solution. 
Choose a viewing window that will allow you to see the behavior of the solu- 
tion. If your solution appears to diverge rapidly or illustrate strange behavior, 
try reducing your step size to h = .001. 

13. y! =e-*, (0) =1 14. y/ = 2e¥ + 32? siny, y(.5) 
15. y! = ay — xy’, y(-1) =1 16.y =|1—27|y+2°, y(1)= 
17.y' =yvV/2r?2 +y2+1+cos(ry), y(0) =1 


‘a 
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18. Use the fourth-order Runge-Kutta method to numerically solve the fol- 
lowing two logistic differential equations for time t between 0 and 1. 
Assume that x«(0) = 100. Solve both using the following h values: 1, 
0.5, 0.25, and 0.1. Compare the solutions of the first equation for the 
different h-values. Explain what is happening as h gets small. Repeat 
the comparison for the second equation. Compare the solutions of the 
two equations to each other for the different h-values. Explain why two 
differential equations that are identical except for the parameter values 
exhibit different behaviors while h is in the process of “getting small.” 


(a) “ = 1.5 (1 o am)’ (b) “ = 2.50 (1 - a) 


19. Consider the initial value problem 


“ = f(x,y), a<a<b, y(o) = Yo; 
x 
with true solution y(a#). Derive the formula used in Euler’s method at 
the ith step in the following manner: assume the approximate and exact 
solutions agree at (2;, y(#;)) and Taylor expand the exact solution at the 
next calculated x-value y(x; + h). Ignore terms of O(h?). 


2.6 An Introduction to Autonomous Second-Order Equa- 
tions 


We will now consider a special class of second-order differential equations, 
useful in applications, that can be solved by methods we know. With first- 
order equations, we considered autonomous equations to be those that did 
not have the independent variable appearing explicitly in the problem. The 
definition here is similar. 


Definition 2.6.1 


A second-order differential equation of the form 


y(t) =h(yy’) (2.26) 


is called autonomous when fh does not depend explicitly on the indepen- 
dent variable t. 


Equation (2.26) can be interpreted as a differential equation whose solutions 
provide the position y(t) of a body that moves according to Newton’s law for 
a special kind of forcing function h. 
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One, perhaps unexpected, way to solve (2.26) is to consider the velocity as 
a function of the position. That is, we let 


d 
vy) = 


so that v is a function of y, rather than t. We also note that this determines 
the acceleration as 


d?y _ d dy 
dt? dt_ dt 


Thus, the task of solving the second-order equation (2.26) is reduced to solving 
the first-order equation 


Solutions can be plotted in the y-v plane and are called orbits. If we can 

solve this transformed equation for u(y), the remaining separable differential 
equation 

dy 

v(y) = = 

Ws. 


can be solved to obtain y(t). 


| Example 1 A simple application of the preceding method is given by the 


motion of a frictionless spring whose deflection y satisfies the initial value 


problem 
dy 
m—~+ky=0 
ae ' 4 
for a positive mass m and a positive spring constant k, with prescribed initial 
values y(0) = yo and y/(0) = vo for the position and velocity. (We will give a 
formal study of harmonic motion later.) Letting 


the equation becomes 
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which is separable and exact (check it!), so that 
mv du + ky dy = 0. 
Integrating gives 


mio k Oe =: 
a” as 


The initial conditions y(0) = yo and y’(0) = vo give 


m k 
c= > +5 ¥0- 
This gives 
m k m k 
50 tay = 5 v0 t 5 vo: 


which can be interpreted as saying that the sum of the kinetic and potential 
energies must remain constant, i.e., the total energy must remain constant. 
Solving this expression for u(y) = dy/dt gives 

dy k ; 3 

a u(y) == rr. ie (2.27) 


where 


m 
a = up +9 


is a constant determined by the initial conditions. The sign of v is uniquely 
determined by the prescribed initial velocity v9. It now remains for us to solve 
(2.27) for y(t). But (2.27) is separable and thus 


_ dy = heel 2 ap 
a? — y? m 
[Ss = 24) Lae 

a? — y? m 
k 
sin-! (2) =14/—t+¢@. 
a m 


Here ¢ is some constant. Thus, the deflection y(t) of the spring is given by 


y(t) = asin ee 4 : 
= (£acos ¢) sin (ye) + (asin ¢) cos (VE) 


so that 


which is 
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where this last expression follows from the trigonometric identity sin(w+v) = 
sin(w) cos(v) + cos(u) sin(v). Letting 


Ci =+acos@é and Cy=asing 


y(t) = Ci sin (y:) + C2 cos (V3) ; 


Now using the initial conditions y(0) = yo and y'(0) = vo we have 


y(t) = yo sin (V)) + U9 COS (VE) : 


which is the familiar equation for simple harmonic motion. 


gives 


Problems 


1. Show that the autonomous equation 
yy” = (y')? 


has solution 


for constants c and k. 


2. In a first physics course, students derive the equation of motion for a 
frictionless simple pendulum as 


mL6” +mgsin@ =0 (2.28) 


where @ is the angle that the pendulum makes with the vertical; however, 
the next step is to assume the angle is small and use the small angle 
approximation (sin? + @+---) to rewrite this equation as 


6” + w7@ = 0, was 


which is conveniently the equation for simple harmonic motion. This ap- 
proximation obviously fails if @ becomes too large. Let’s revisit (2.28) 
and consider this as an autonomous equation. Let v = d0/dt and use 
the methods of this section to derive a total energy formula. Use this 
expression to verify the plot of some of the orbits in Figure 2.27. Al 
ternatively, plot this total energy formula to obtain the orbits in Figure 
2.27. Interpret the three qualitatively different orbits, keeping in mind 
that the pendulum is allowed to whirl over the top. 
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a7 Gg ; cane 
0’7’+ 7 s!ne—0 


-6 4 -2 0 2 4 6 
§— 
FIGURE 2.27: Orbits for simple pendulum with g = 9.8, 2 = 1. 


. Suppose the position of a body of mass m that is shot up from the surface 
of the Earth satisfies the inverse square law 


R?2 


ma!"() = —ma-aay: 


where x(t) is the distance from the Earth’s center at time t, R is the 
Earth’s radius, and the initial conditions are 


z(0)=R>0 and 2/(0)=v>0. 
If ve > 2gR, show that the body will never return to Earth. The so- 


lution defines the escape velocity for the body. (Hint: Determine the 
expression for v(a) and its sign.) 
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The nonlinear equation 


Py fe, (wy 
dx2 ' \ da 
describes the position y of a suspension cable, which either supports a 


bridge or hangs under its own weight. The equation is of the form (2.26), 
but it is also of the form 


y"(x) = f(x,y’), 
where y = y(a) and the right-hand side f is independent of y. 


(a) Let u(a) = dy/dx and derive a first-order equation in terms of only 
u,v, that is of the form: 


(b) Solve this equation to obtain 
a — 29 =In(u+ V1 +4 w2) 
for some constant 2. 


(c) Exponentiate the above equation and the negative of it and combine 
appropriately to obtain the expression 


— (em 4 e720), 

(d) Using the original substitution u(a) = dy/dax, obtain the equation 
y(x) = cosh(a — 20) + ¢, 

which is the (familiar) equation for the catenary, where Zo is the location 


of the zero of y’ (i.e., the minimum of y) and c is 0 if that minimum value 
is l. 


Chapter 2 Review 


In Problems 1-6, determine whether the statement is true or false. If it is 
true, give reasons for your answer. If it is false, give a counterexample or 
other explanation of why it is false. 


1. 


The Existence and Uniqueness theorem allows us to conclude that solu- 
tions to y’ = tan y will always exist and be unique. 
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. The Existence and Uniqueness theorem allows us to state that the solu- 
tion to y’! = x?y'/8 passing through the initial condition y(1) = 0 will not 
be unique. 

. The Runge-Kutta method for approximating the solution to an ODE is 
superior to Euler’s method because it uses 1/2 the step size of Euler’s 
method to calculate the approximate solution. 


. The Euler and Runge-Kutta methods are both used for numerically ap- 
proximating the solution to a differential equation. Euler’s method is 
superior to the Runge-Kutta method because the step size is smaller and 
thus the approximations are better at each step. 


. The Allee model of population growth is often considered superior to the 
Logistic model because it models the need for a critical population level 
in order for the species to survive. 


. Autonomous equations can be written as 22 = f(x) and are useful be- 
q dt 


cause we are able to obtain long-term behavior of the solutions quickly. 


In Problems 7-13, determine the region(s) of the x-y plane where solutions 
(i) exist and also where solutions (ii) exist and are unique, according to the 
Existence and Uniqueness theorem. 


dy 2/3 dy 1/3 dy 2/3 
— = | 8. = -1 9. =27- 
7 da Qu y da (cy — 1) da cy 
10. &Y _ ytane 11. &Y — singe —tany 12. oY = secy 
dx dx dx 


13. dy = ey/(+1) 
dx 


. In the direction field given in Figure 2.28(a), sketch the solution to y! = 
x” — y that passes through the initial condition y(—2) = 0. 


ae ee fa a AO 
jf are a ey A te iy A TG 
PAN WN NS V\ \WNIKN Se 7 
a Gee a AOS ee 
a a VAR ASS 
, i eae | ey ea 
Lf f= sr yp \ AO RS 
$f [2h Ae" 7 TT a ee ee er 
Bera 2 ae Ve NAAT A NO 
LT age et bt ek i NN 


FIGURE 2.28: (a) Graph for Problem 14. (b) Graph for Problem 15. 
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15. In the direction field given in Figure 2.28(b), sketch the solution to y/ = 
x —y” that passes through the initial condition y(0) = 0. 

16. Consider the autonomous equation y’ = (3 + y)(2— y). 
(a) Find the equilibria. 
(b) Draw a graph in the y-y’ plane and indicate the stability of these 
points by drawing the appropriate arrows on the phase line. 
(c) Explicitly state the stability of the equilibrium solutions. 
(d) Sketch solutions in the x-y plane. 


17. The following equation has been proposed to model the level of a certain 
harmful bacteria in the body: 


xz’ =2(x—a)(x—4), 


where 0 <a<4, v=<2(t),a2>0. 

a) Draw the phase line diagram and determine the stability of the equi- 
librium solutions. 

b) Describe the long-term behavior of the solution for any initial condi- 
tion. 

c) Sketch solutions in the t-a plane. 

18. Consider the autonomous ODE y’ = (1— y)(2+y). 

a) Find the equilibria. 

b) Draw a graph in the y-y’ plane and indicate the stability of these 
points by drawing the appropriate arrows on the phase line. 

c) Explicitly state the stability of the equilibrium solutions. 

d) Sketch solutions in the a-y plane. 

19. Match the two given direction fields in Figure 2.29 with their respective 
equations. 

a) y' = y"(xy — 1), (b) y = «?(ay? — 1), (c) y! = xy(1— 27), 

d) y' = y(zy — 1) 


VV VA \\ \QQ)N 277 \\\~,-—-/ | | 
VV VANANANH*,7 \\\-44 wae 
VANAANNN\XN-- \\\N—+ 7 | | 
VV\\NN\NNSNXN™- \\\N> 7 1! 
V\\\N\NSNS bh Re eee 
eee VV \V\\XN—4——SNAA\\ 
: ew A a a a 
aa alienated: Sadialaied VAN NRA EAA I 
mm aaa VV VY VANS 
NNN OAH LL \\\N— ~//] 
Wiese (LENS == 
VAA\N\ SAY 7/1 1 1 ee ee 


FIGURE 2.29: Direction fields for Problem 19. 
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20. Match the two given direction fields in Figure 2.30 with their respective 
equations. 


(a) y = y(2? —1), (b) y =ysinaz, (c) y = y(1—27), (d) ¥ =yy?-)) 


Setees eee eee 
EEL PILE ///1 
LILLE GL EL TILE 
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YSN NN 
//-~\\X\ ETE ETE 


FIGURE 2.30: Direction fields for Problem 20. 


In Problems 21-26, graph the equation in the x-a’ plane and then use phase 
line analysis to determine the stability of the equilibria. 


21. a! = x?(x — 2)(4— 32) 22. x’ = (x? — 9)?(x — 1) 
23.2’ = (1+ 2)(3+2r)(5— 2x)’ 24. 2! = x*(2r—3)3(x2+4) (x? +22+1) 
25. 2’ = (16 — 327)(2? — 4)8 26. 2! = 2(4 — 32)3 (22 + 1)*(2? — 1) 


In Problems 27-29, let the parameter r vary and determine the bifurcation 
that occurs by drawing the two qualitatively different phase line portraits. 
State the stability of the equilibria for both pictures. Draw the bifurcation 
diagram as well. 

27.y'=1-r-y? 28.y =r—-y-e4¥ 29. y' =y(1l—y)—ry 


30. Show that the constant yield harvesting equation 


can be non-dimensionalized to give x’ = a(1 — x) — h. What type of 
bifurcation occurs? Discuss why this is not a good model for harvesting. 


Use MATLAB, Maple, or Mathematics to solve each of Problems 31-38. 
Find the numerical solution using the fourth-order Runge-Kutta method with 
h = 0.1. Compare this to the solution obtained using Euler’s method with 
h =0.1 (either with a table or by plotting). 
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31. 2ry'+y2 =1, y(l)=7 32. ry’ +27 +a2y—y=0, y(1)=1 
33.y—y' =y'?4+2y’, y(2) =0 34. (x +2y3)y’ =y, y(-l)=1 

35. 27y! =y(at+y), y(V2)=1 36. (1—2?)y’+2y=0, y(0)=5 
37. (Qry? —y)?+2y' =0, y(t) =1 38. y?4+2(r—-1)y’-2y =0, y(0) =—3 
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Chapter 2 Computer Lab: MATLAB 


MATLAB Example 1: Enter the following code that demonstrates how to 


il 
plot direction fields in MATLAB for y! = 


x2 + y? 
>> clear all 
>> [X,Y]=meshgrid(-3: .55:3,-3:.55:3); “Note the CAPITAL letters 
>> DY=1./(X.%2+Y.%2); ZDY is rhs of original equation 
>> DX=ones(size(DY)) ; 
>> DW=sqrt (DX. 2+DY.%2); %the length of each vector 
>> quiver(X,Y,DX./DW,DY./DW,.5,’.’); %plots normalized vectors 
S> xlabel(’x’); 
>> ylabel(’y’); 


MATLAB Example 2: Enter the following code that demonstrates how to 


plot solution curves for y/ = 5: You will first need to create a function 


x + 
Ch2Example.m that contains the ODE that will be solved numerically. Do 


not close your figure from Example 1 above. 


“#Create a function Ch2Example.m and enter the following commands 
function dy= Ch2Example(x,y) 

hh 

%The original ode is dy/dx=1/(x/2ty*2) 

hh 

oy = 1/GAD 2 yAD)s 

wend of function Ch2Example.m 
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After having created and saved the above function, type the following in the 
Command Window. 

SS nO H8)5 rai S8p yO==85 

>> options=odeset(’refine’,10,’AbsTol’,1e-15); 

>  [x, y]=ode45 (@Ch2Example, [x0,xf] ,y0, options) ; 
S> RO=“S)5 saiSse yO=—25 

> [x1,y1]=ode45 (@Ch2Example, [x0,xf] ,y0, options) ; 
S> ROS“8)5 sais yO=—il5 

>> [x2,y2]=ode45 (@Ch2Example, [x0,xf] ,y0, options) ; 
SS MO=—S)5 sais yO=05 

> [x3,y3]=ode45(@Ch2Example, [x0,xf] ,y0, options) ; 
>> hold on %keeps direction field plot open 

>> plot(x,y) “superimpose solutions 

SS aas([-S 8 =-8 i) 

> plot(xt,y1) 

>> plot(x2,y2) 

> plot(x3,y3) 

>> hold off 


MATLAB Example 3: Enter the following code that creates three func- 
tions Euler.m, RK4.m, and Ch2NumExample.m that respectively contain the 
Euler method, 4th order Runge-Kutta methods, and the ODE that will be 
solved numerically. Then enter the commands to call these functions in order 
to compare their output. The final group of commands will superimpose 
the RK4 solution onto the direction field. The IVP we consider is y' = xy, 


y(0) = 1. 


#Create a function Euler.m and enter the following commands 
function [xout,yout]=Euler(fname,xvals,y0,h) 

&%This code implements the Euler Method for numerically 
#solving y’=f (x,y) 

th 

/fname=the function f for the ODE 

“%xvals = vector that contains the initial x0 and xf 

“yO = initial y 

Zh = stepsize 


x0=xvals(1); xf=xvals(2); 

x=x0; y=y0; 

steps=(xf-x0)/h; 

xout=zeros(stepsti, 1);% allocates space for xout 
yout=zeros(stepsti, 1);% allocates space for yout 
xout(1)=x; yout(1)=y; 
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tore JHU sss 
f=feval(fname,x,y); 
x=xth; 
y=yth*t ; 
xout (j+1)=x; 
yout (j+1)=y; 

end 

Zend of function Euler.m 


/#Create a function RK4.m and enter the following commands 
function [xout, yout]=RK4(fname,xvals,y0,h) 

“This code implements the 4th order Runge-Kutta method for 
#numerically solving the ODE y’=f(x,y) 

hh 

%#fname = the function f for the equation. 

“xO =initial x 

%#n = number of steps to be taken. 

“#yO =initial y 

va =stepsize 


x0=xvals(1); xf=xvals(2); 

x=x0; y=y0; 

steps=(xf-x0) /h; 

f=feval(fname,x,y); 

xout=zeros(stepst1, 1);% allocates space for xout 
yout=zeros(stepst1, length(f));% allocates space for yout 
y=y’; “The ’ is needed to match syntax of ode45 in higher dim 
xout(1,1)=x; yout(1,:)=y; 


for i=1:steps 
ki = hf; 


k2 = h*feval(fname,x+(h/2) ,y+(k1/2)); 
k3 = h*feval(fname,x+(h/2) ,y+(k2/2)); 
k4 = h*feval (fname ,xth, y+k3) ; 


ynext = y +(ki + 2*k2 + 2*k3 + k4)/6; 
xnext = xth; 
f = feval(fname,xnext, ynext) ; 
xout(i,:)=xnext; 
yout(i,:)=ynext’; “we again need the ’ 
x=xnext ; 
y=ynext ; 

end 

fend of function RK4.m 
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“%Create a function Ch2NumExample.m and enter the following 
commands 

function dy= Ch2NumExample(x,y) 

th 

&%The original ode is dy/dx=x*y 

hh 

dy = x*y; 

end of function Ch2NumExample.m 


After having created and saved the above three functions, type the following 

in the Command Window. 

S> elleeue eull 

> close all 

SS MOH05 satSsiiilg yOSls is_ils 

>  [x, y]=Euler(@Ch2NumExample, [x0, xf],y0,h); 

aay) 

> [xt,y1]=RK4(@Ch2NumExample, [x0 xf],y0,h); 

S> [bal will 

SS peed 0g ingore 8 

>> y2= exp(x2.2/2); %this is the analytical solution 

S> (be? y27] 

>> plot(x,y,’b:’) %Now graphically compare Euler with RK4 

> hold on 

SS pllonGeil wil, w—?) 

>> xlabel(’x’) 

>> ylabel(’y’) 

>> title(’Numerical solns of y\{prime} =xy using EM and RK4 
with h=.1, dotted/blue is EM, dashed/black is RK4’) 

>> hold off 


The following commands will superimpose the plots of the numerical solution 
from RK4.m (obtained above) and the direction field. 
>> plot(xi,y1,’k--’,’LineWidth’ ,2) 

> hold on 

>> [X,Y]=meshgrid(-3: .3:3,0:.3:4); 

>> DY=X.*Y; ZDY is rhs of original equation 
>> DX=ones(size(DY)); 

>> DW=sqrt (DX.*2+DY."2); 

>> quiver(X,Y,DX./DW,DY./DW,.4,’.’); 

>> xlabel(’x’); 

>> ylabel(y’); 
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SS eais([e3 8 © 4) 
> hold off 


Z%End of Example 3. 


MATLAB Example 4: If you covered the topic of bifurcations in class or 
are instructed to read this on your own by your instructor, enter the following 
commands to illustrate how to animate the qualitatively different solutions 
of the ODE with a supercritical bifurcation, y’ = ry — y®. The final set of 
commands superimposes three different qualitative solutions observed during 
the animation. Although it can be entered into the Command Window, the 
following code should be entered into a MATLAB Script instead. 


ZEnter into a Script for easier manipulation 
clear all 
close all 
ie ha ae 
We-2 5s eA tg 
figure 
axieQ[=2.5: 2.6 =1.515)])) 
for j = 1:length(r) 
eqi = r(j)*y-y.*3; % rhs of supercritical pitchfork bifn 
plot (y,eq1) 
Sarees 2s alls alts) 
title([’r=’ ,num2str(r(j))]) 
xlabel(’y’); ylabel(’y\{prime}’) ; 
grid 
drawnow 
pause(.05); 
end 
figure 
plot(y,-2*y-y.%3,’b’) %plot for r=-2 
hold on 
plOBG) 7S, ©?) Hsllew or c=0 
plot(y,2*y-y.%3,’k’) %plot for r=2 
legend(’r<0’, ’r=0’, ’r>0’) 
gociei(I=27 50) 2.506 at- 5 4.51) 
hold off 


Dfield in MATLAB 
For a first-order system, a very user-friendly software supplement 
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called dfield, written by John C. Polking, may be found at 
<http://math.rice.edu/~dfield/>, exists for MATLAB and it is freely 
available for educational use. There are two or three programs that you will 
need to download (depending on your version of MATLAB) and install in your 
working directory. The program dfield (like its two-dimensional counterpart 
pplane that we will encounter in Chapter 6) is much easier to implement than 
either of the above methods for plotting direction fields and superimposing 
numerical solutions. We give a brief introduction here. 

Once you have placed the relevant programs in your working directory, type 
dfields. A new window should pop up; see the Figure 2.31. (Note that this 
is for MATLAB 7.7 or later. Download the appropriate files for other versions 
of MATLAB.) 

The dependent variable, by default, is x(t) but we can easily change these 
in the window so that everything will be in terms of y(a). We consider the 
equations given below and enter them in the dfield window as 


y?=1/ (x 2+y*2) 


and we must also specify that the independent variable is x (as opposed to 
the default variable t). 

For other problems, we may have parameters or expressions to enter. For 
this problem, we also need to modify the minimum and maximum values of x 
and y. We set the minimum z-value to be —3, the maximum z-value to be 38, 
the minimum y-value to be —4, and the maximum y-value to be 4. We click 
the Proceed button on the window that we have been typing to generate the 
direction field. To plot solutions, we simply click on the direction field at a 
desired initial condition. Repeat a few times. The reader should experiment 
with the Options on the display window and see other options for plotting. 


MATLAB Exercises 

Turn in both the commands that you enter for the exercises below as well as 
the output/figures. These should all be in one document. Please highlight or 
clearly indicate all requested answers. Some of the questions will require you 
to modify the above MATLAB code to answer them. 


1. Enter the commands given in MATLAB Example 1 and submit both your 
input and output. 

2. Enter the commands given in MATLAB Example 2 and submit both your 
input and output. 

3. Enter the commands given in MATLAB Example 3 and submit both your 
input and output. 
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80.9 _dfield8 Setup 
File Edit Gallery Desktop Window Help 


The differential equation. 
= 1/(x*2+y%2) 


The independent variable is x ] 


Parameters 
& 
expressions: 

The display window. 


The minimum value of x = 3 The minimum value of y = 
| The maximum value of y = 


FIGURE 2.31: Pop-up window for dfield8 program, used to obtain nu- 
merical solutions to first-order equations. 


4, Enter the commands given in MATLAB Example 4 and submit both your 
input and output. 
5. Plot the direction fields for the following ODEs: 
(a) yf =y +2? (b) y' = sin(2*) 
(c) y' = ay? (d) y =1-y?. 
6. Superimpose three solutions onto the direction fields of the ODEs from 


HOE 


(a) y =y+2? (b) y/ =sin(z”) 
(c) yf = ay? (d) y =1-y°. 
7. Plot the direction fields for the following ODEs: 
(a) y' = y(1—y) (b) y/ =sin(y*) 
(c) y =y°(3-y°) (yy 28 (1 2), 


8. Superimpose three solutions onto the direction fields of the ODEs from 


(2) a gil) (b) y’ =sin(y’) 
(c) vy =y'(3-y") (d) y =2°(1—y?). 
9. For y’ = y+ x? with y(0) = —1, use a stepsize of h = 0.1 to obtain the 
solutions from the Euler method and the 4th order Runge-Kutta method. 
For the same ODE and IC, also obtain the analytical solution (either by 
hand or by using dsolve [in R2012 or later]). Compare the values of the 
three solutions at x = 0,0.1,1, 5. 
10. Repeat the instructions in #9 for the stepsize h = 0.01. 
11. For y’ = x(y +1)? with y(0) = 2, use a stepsize of h = 0.25 to obtain the 
solutions from the Euler method and the 4th order Runge-Kutta method. 


1, 
il}, 


14. 
15. 


16. 


NY, 
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For the same ODE and IC, also obtain the analytical solution (either by 
hand or by using dsolve). Compare the values of the three solutions at 
i = (0), 05, %, 

Repeat the instructions in #11 for the stepsize h = 0.1. 

For y’ = (x — 1) cos?(y) with y(0) = 0, use a stepsize of h = 0.2 to obtain 
the solutions from the Euler method and the 4th order Runge-Kutta 
method. For the same ODE and IC, also obtain the analytical solution 
(either by hand or by using dsolve). Compare the values of the three 
solutions at x = 0,0.4, 2,5. 


Repeat the instructions in #13 for the stepsize h = 0.05. 


If you covered the topic of bifurcations in class or are instructed to read 
this on your own by your instructor, animate the qualitatively different 
solutions of the ODE with a transcritical bifurcation, y! = ry — y?. Then 
superimpose the plots of three qualitatively different solutions, i.e., one 
for each of r < 0, r=0, and r > 0. 


If you covered the topic of bifurcations in class or are instructed to read 
this on your own by your instructor, animate the qualitatively different 
solutions of the ODE y’ = ry? — y®. What type of bifurcation is this? 
Then superimpose the plots of three qualitatively different solutions, i.e., 
one for each of r < 0, r=0, and r > 0. 


If you covered the topic of bifurcations in class or are instructed to read 
this on your own by your instructor, animate the qualitatively different 
solutions of the ODE y’ = r + 3y — 4y?. What are the two bifurcations 
that occur? Then superimpose the plots of five qualitatively different 
solutions, i-e., one for each of r < —1, r= —1, -1<r<1,r=1, and 
Polk 
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1 
direction fields in Maple for y’ = cae: Please note that the derivative 
zt y 
d 
symbol that appears below is always entered from the Expression palette ae ie 
ie 


restart 
with(DEtools): #Loads the needed diff eqns package 


Maple Example 1: Enter the following code that demonstrates how to plot 
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d (x) 1 

Hae (oe 

da” x? + y(z)? 

dfieldplot(eq1, y(x), 7 = —3..3, y = —3..3, arrows = line, dirgrid = (10, 10]) 


Coll = 


Maple Example 2: Enter the following code that demonstrates how to plot 


solution curves for y’ = Do not type restart as you will need the 


x+y? 
ODE egq1 from Example 1 above. 


with(plots): 

IC1 := y(—3) = —3 

soln1 := dsolve({eq1,IC1}, y(x), numeric, range = —10..10) : 

IC2:= y(—3) = -2 

soln2 := dsolve({eq1,IC 2}, y(x), numeric, range = —10..10) : 

IC3 := y(—3) =—-1 

soln’ := dsolve({eq1,IC3}, y(x), numeric, range = —10..10) : 

IC4 := y(—3) =0 

soln4 := dsolve({ eq1,IC4}, y(x), numeric, range = —10..10) : 

eq2 := odeplot(soln1, [x, y(x)], numpoints = 200, thickness = 2) : 

eg3 := odeplot(soln2, [x, y(x)], numpoints = 200, thickness = 2) : 

eq4 := odeplot(soln8, [x, y(x)], refine = 2, thickness = 2) : 

eqd := odeplot(soln4, [x, y(x)], refine = 2, thickness = 2) : 

eq6 := dfieldplot(eq1, y(x), x = —3..3, y = —3..3, arrows = line, dirgrid 
= (10, 10]) : 

indexMaple commands! dfieldplot display([eq2, eq3, eq4, eq5, eq6]) 


Maple Example 3: Enter the following code that utilizes Maple’s built-in 
Euler method and 4th order Runge-Kutta method. The first set of commands 
will obtain these numerical solutions while the final group of commands will 
superimpose the Runge-Kutta solution onto the direction field. The IVP we 
consider is y’ = ry, y(0) = 1. 


restart 
with(plots): 


egt = Cy(2) = 2: y(c) 
a 

C= yO) = 1 

solnEM := dsolve({IC, eq1}, y(x), numeric, method = classicall foreuler], 
stepsize = .1): 

solnRK4 := dsolve({IC, eq1}, y(x), numeric, method = classical[rk4 ], 
stepsize = .1): 

solnEM(.3) 

solnRK4(.3) 
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solnEM(3.1) 

solnRK4(3.1) 

soln := dsolve({IC, eq1}, y(x)) 

evalf(subs(a = .3, soln)) 

evalf(subs(a = 3.1, soln)) 
##Note that solnRK4 compares well with the exact answer but solnEM 
compares horribly 

eq2 := odeplot(solnEM, |x, y(x)|, view = [—3..3, 0..120], labels = [x,y], 
numpoints = 500, color = blue, linestyle = 2) 

eq3 := odeplot(solnRK4, [x, y(x)], view = [—3..3, 0..120], labels = [x, y], 
numpoints = 500, color = black, linestyle = 3) : 

display([eq2, eq3], title =” Numerical solns of y’=xy using EM and RK4 with 
h=.1, dotted/blue is EM, dashed/black is RK4") 

#Now we superimpose solnRK4 onto the direction field 

with(DEtools): 

eq4 := odeplot(solnRK4, |x, y(x)], view = [—3..3, 0..4], labels = [x, y], 
numpoints = 500) : 

eqd := dfieldplot(eq1, y(x), x = —3..3, y = 0..4, arrows = line) : 

display([eq4, eqd |) 


Maple Example 4: If you covered the topic of bifurcations in class or 
are instructed to read this on your own by your instructor, enter the 
following commands to illustrate how to animate the qualitatively different 
solutions of the ODE with a supercritical bifurcation, y’ = ry — y®. The last 
command superimposes three different qualitative solutions observed during 
the animation. 


restart 

with(plots): 

eql:=r-y—y? #the rhs of y’=f(r,y) for a supercritical pitchfork bifurcation 

animate(plot, [eq1, y = —2.5..2.5, —1.5..1.5], r = —2..2) 
#4 When figure appears, right click on it, then go to Animation > Play. 
Alternatively, in the toolbar beneath the button Animation and to the 
right of Current Frame, move the vertical bar to animate figure. 

plot([subs(r = —2, eq1), subs(r = 0, eg1), subs(r = 2, eq1)], y = —2.5..2.5, 
=ILS.oll 5, lanemd = |"? <0" Yr =O", > O"]) 


Maple Exercises 

Turn in both the commands that you enter for the exercises below as well as 
the output/figures. These should all be in one document. Please highlight or 
clearly indicate all requested answers. Some of the questions will require you 
to modify the above Maple code to answer them. 
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1. Enter the commands given in Maple Example 1 and submit both your 
input and output. 
2. Enter the commands given in Maple Example 2 and submit both your 
input and output. 
3. Enter the commands given in Maple Example 3 and submit both your 
input and output. 


4. Enter the commands given in Maple Example 4 and submit both your 
input and output. 
5. Plot the direction fields for the following ODEs: 
(a) y =y +2? (b) y’ =sin(2’) 
(c) y' =2y? (d) y =1-y?. 
6. Superimpose three solutions onto the direction fields of the ODEs from 


san 


(a) y =y+2° (b) y' =sin(2*) 
(c) y = ay? (d) y =1-y’. 
7. Plot the direction fields for the following ODEs: 
(a) y’ =y(1—y) (b) y/ =sin(y’) 
() y=y'G-y) (d) y/=a°(1—y”). 


8. Superimpose three solutions onto the direction fields of the ODEs from 


(a) y¥ =y(1—y) (b) y' =sin(y’) 
(c) y =y(3-y) (d) y =2°(1—y?). 

9. For y’ = y+ x? with y(0) = —1, use a stepsize of h = 0.1 to obtain the 
solutions from the Euler method and the 4th order Runge-Kutta method. 
For the same ODE and IC, also obtain the analytical solution (either by 
hand or by using dsolve). Compare the values of the three solutions at 
42 = 0), Oi, 1,5. 

10. Repeat the instructions in #9 for the stepsize h = 0.01. 


11. For y’ = z(y+1)? with y(0) = 2, use a stepsize of h = 0.25 to obtain the 
solutions from the Euler method and the 4th order Runge-Kutta method. 
For the same ODE and IC, also obtain the analytical solution (either by 
hand or by using dsolve). Compare the values of the three solutions at 
ae = 0, 0.5, 2, 5. 

12. Repeat the instructions in #11 for the stepsize h = 0.1. 


13. For y’ = (a — 1) cos?(y) with y(0) = 0, use a stepsize of h = 0.2 to obtain 
the solutions from the Euler method and the 4th order Runge-Kutta 
method. For the same ODE and IC, also obtain the analytical solution 
(either by hand or by using dsolve). Compare the values of the three 
solutions at x = 0,0.4, 2,5. 


14. Repeat the instructions in #13 for the stepsize h = 0.05. 
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15. If you covered the topic of bifurcations in class or are instructed to read 
this on your own by your instructor, animate the qualitatively different 
solutions of the ODE with a transcritical bifurcation, y! = ry — y?. Then 
superimpose the plots of three qualitatively different solutions, i.e., one 
for each of r < 0, r=0, andr > 0. 


16. If you covered the topic of bifurcations in class or are instructed to read 
this on your own by your instructor, animate the qualitatively different 
solutions of the ODE y’ = ry? — y®. What type of bifurcation is this? 
Then superimpose the plots of three qualitatively different solutions, i.e., 
one for each of r < 0, r=0, and r > 0. 


17. If you covered the topic of bifurcations in class or are instructed to read 
this on your own by your instructor, animate the qualitatively different 
solutions of the ODE y’ = r + 3y — 4y?. What are the two bifurcations 
that occur? Then superimpose the plots of five qualitatively different 
solutions, i.e., one for each of r < —1, r= —1, -1<r<1,r=1, and 
pS Il 
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Mathematica Example 1: Enter the following code that demonstrates 


1 
how to plot direction fields in Maple for y’ = -—~. 
oye 
Quit|] 
il 
t{x_,y J=——— 
ee EEL 


pO = VecwonPiloci{i, oaillke, wil}, te, 8, St, thy =<, dt, 
VectorScale{.05, .05, None}, VectorPoints—>10, 
VectorStyle— "Segment"] 


Mathematica Example 2: Enter the following code that demonstrates 


1 
how to plot solution curves for y’ = leas Do not type Quit[ ] as you 
at y 
will need the direction field from Example 1 above. 
al 
D) as 
eae Eee 


sol1 = NDSolvel{y’ [x]==eq2[x], y[-3]==-3}, y, {x, -10, 10}] 
(*Result is an Interpolating Function. *) 
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sol2 = NDSolve[{y’ [x]==eq2[x], y[-3]==-2}, y, {x, -10, 10}]; 

sol3 = NDSolvel[{y’ [x]==eq2[x], y[-3]==-1}, y, {x, -10, 10}]; 

sol4 = NDSolvel[{y’ [x]==eq2[x], y[-3]==0}, y, {x, -10, 10}]; 
(*y[x]/.sol1 is the solution we seek.*) 

pi = Plot [Evaluatel[y[x]/.sol1], {x, -3, 3}, PlotRange—{-3, 3}, 
PlotStyle—{Thickness[.01]}]; 

p2 = Plot [Evaluate[y[x]/.sol2], {x, -3, 3}, PlotRange-{-3, 3}, 
PlotStyle—{Thickness[.01]}]; 

p3 = Plot [Evaluatel[y[x]/.so13], {x, -3, 3}, PlotRange—{-3, 3}, 
PlotStyle—{Thickness[.01]}]; 

p4 = Plot [Evaluately[x]/.sol14], {x, -3, 3}, PlotRange—{-3, 3}, 
PlotStyle—{Thickness[.01]}]; 

Show[p0O, pi, p2, p3, p4] 


Mathematica Example 3: Enter the following code that utilizes Mathe- 
matica’s built-in Euler method and 4th order Runge-Kutta method. The first 
set of commands will obtain these numerical solutions while the final group 
of commands will superimpose the Runge-Kutta solution onto the direction 
field. The IVP we consider is y’ = xy, y(0) = 1. 


Quit| | 

de[x_]=xylx] (*don’t forget <space> for multiplication*) 

solutionEM=NDSolve[{y’ [x]==del[x], y[0]==1}, y, {x, 0, 4}, 
StartingStepSize—.1, 

Method—{FixedStep, Method—ExplicitEuler}] 

solutionRK=NDSolve[{y’ [x]==del[x], y[0]==1}, y, {x, 0, 4}, 

StartingStepSize—.1, 

Method—{FixedStep, Method—ExplicitRungeKutta}] 

yEM[x_] = ylx]/.solutionEM[[1]] 

yRK[x_] ylx]/.solutionRK[[1]] 

yEM[.3] 

yRK[.3] 

yEM[3.1] 

yRK [3.1] 

soln = DSolve[{y’ [x]==del[x], y[0]==1}, yx], x] 

ReplaceAll[soln[[1]]([1]], x—.3] 

ReplaceAll[soln[[1J][{1]], x-3.1] 

pi = Plot[yEM[x], {x, 0, 3}, PlotRange—{0, 120}, 

PlotStyle—{Blue, Dotted}]; 

p2 = Plot[yRK[x], {x, 0, 3}, PlotRange—{0, 120}, 

PlotStyle—+{Black, Dashed}]; 

Show[p1, p2, PlotLabel—"Numerical Solns of y’=xy using 
EM and RK4 with h=.1, dotted/blue is EM, dashed/black is RK4"] 
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dellgaryial—eesy 

pO = VectorPlot[{1, delx, y]}, {x, 0, 3}, {y, 0, 4}, 
VectorScale—{.05, .05, None}, VectorPoints—10, 
VectorStyle—"Segment"] ; 

Show[p0O, p2] 


Mathematica Example 4: If you covered the topic of bifurcations in class 
or are instructed to read this on your own by your instructor, enter the 
following commands to illustrate how to animate the qualitatively different 
solutions of the ODE with a supercritical bifurcation, y’ = ry — y®. The last 
command superimposes three different qualitative solutions observed during 
the animation. 


Quit] 
flr_,y_] = ry -y® (*don’t forget <space> for multiplication*) 
Neale Pilow|belke, wl, fv, “2.5, 280), te, 2, Qh 
(*Now move the circle on the r-scale to animate*) 
Plot[{ReplaceAll[f[r, y], r-2], ReplaceAll[f[r, y], r-0], 
ReplaceAll[f[r, y], r—2]}, {y, -2.5, 2.5}, 
PlotLegends—+{"r<0", "r=0", "r>0"}] 


Mathematica Exercises 

Turn in both the commands that you enter for the exercises below as well as 
the output/figures. These should all be in one document. Please highlight or 
clearly indicate all requested answers. Some of the questions will require you 
to modify the above Mathematica code to answer them. 


1. Enter the commands given in Mathematica Example 1 and submit both 
your input and output. 
2. Enter the commands given in Mathematica Example 2 and submit both 
your input and output. 
3. Enter the commands given in Mathematica Example 3 and submit both 
your input and output. 


4. Enter the commands given in Mathematica Example 4 and submit both 
your input and output. 


5. Plot the direction fields for the following ODEs: 
(a) y =yt2? (b) y' =sin(2’) 
(c) yl =ay? (dy jl. 
6. Superimpose three solutions onto the direction fields of the ODEs from 
#£5: 
(a) y =yt2? (b) 


y in(x”) 
(c) y = ay? (d) 


2 


y! 
y’ = AP. 


lI 
Hen 
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7. Plot the direction fields for the following ODEs: 
(a) y’ =y(1—y) (b) y' =sin(y’) 
(c) y =y(3-y") (d) y =2°(1—y’). 

8. Superimpose three solutions onto the direction fields of the ODEs from 
He 

(a) y’ =y(1—y) (b) y' =sin(y’) 
(c) y =y°(3-y*) (d) y =2°(1—y’). 

9. For y’ = y+ x? with y(0) = —1, use a stepsize of h = 0.1 to obtain the 
solutions from the Euler method and the 4th order Runge-Kutta method. 
For the same ODE and IC, also obtain the analytical solution (either by 
hand or by using dsolve). Compare the values of the three solutions at 
g = (0), 0.1L, i, 5. 

10. Repeat the instructions in #9 for the stepsize h = 0.01. 

11. For y’ = x(y +1)? with y(0) = 2, use a stepsize of h = 0.25 to obtain the 
solutions from the Euler method and the 4th order Runge-Kutta method. 
For the same ODE and IC, also obtain the analytical solution (either by 
hand or by using dsolve). Compare the values of the three solutions at 
a = 0,,0.5, 2, &. 

12. Repeat the instructions in #11 for the stepsize h = 0.1. 

13. For y’ = (a — 1) cos?(y) with y(0) = 0, use a stepsize of h = 0.2 to obtain 
the solutions from the Euler method and the 4th order Runge-Kutta 
method. For the same ODE and IC, also obtain the analytical solution 
(either by hand or by using dsolve). Compare the values of the three 
solutions at x = 0,0.4, 2,5. 

14. Repeat the instructions in #13 for the stepsize h = 0.05. 

15. If you covered the topic of bifurcations in class or are instructed to read 
this on your own by your instructor, animate the qualitatively different 
solutions of the ODE with a transcritical bifurcation, y’ = ry — y?. Then 
superimpose the plots of three qualitatively different solutions, i.e., one 
for each of r < 0, r=0, and r > 0. 

16. If you covered the topic of bifurcations in class or are instructed to read 
this on your own by your instructor, animate the qualitatively different 
solutions of the ODE y’ = ry? — y°®. What type of bifurcation is this? 
Then superimpose the plots of three qualitatively different solutions, i.e., 
one for each of r < 0, r =0, andr > 0. 

17. If you covered the topic of bifurcations in class or are instructed to read 
this on your own by your instructor, animate the qualitatively different 
solutions of the ODE y’ = r + 3y — 4y°. What are the two bifurcations 
that occur? Then superimpose the plots of five qualitatively different 
solutions, i.e., one for each of r < —1,r = —1, -l1<r<1,r=1, and 
pS il. 
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Project 2A: Spruce Budworm 

We consider the famous spruce budworm model which was used to de- 
scribe the dynamics of this population on a forest in Canada. Period- 
ically, there were large outbreaks of the budworm that devastated the 
forest. The forest would recover and then a similar outbreak would oc- 
cur. A simple first-order autonomous ODE was proposed to explain the 
behavior [33],[37], [48]: 


dN N aN? 
ee Nal ; ; 
a ( x) B2 + N2 a 


Here, N represents the population of the budworm, p is the growth rate 
(assumed to be logistic), and K is the carrying capacity. From calculus, 
we can observe that the second term is 0 when N = 0, approaches a as 
N gets large, and reaches its steepest ascent when N = £. 


e Show that (2.29) can be written in the dimensionless form 


2 


dx ae iG 


e Show that the system has between one and three biologically mean- 
ingful equilibria. (Hint: if it helps, graph the two terms separately 
but on the same graph.) 


e Determine the stability of the equilibria. Your answer will have a 
dependence on the values of the parameters r and k. 


e Find the equation, in terms of the parameters r and k, that de- 
scribes where the system changes from one to three equilibria. 


e Give a biological interpretation for the system with one equilbrium 
point vs. three equilibria. 


Project 2B: Multistep Methods of Numerical Approx- 
imation 
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Many numerical methods for solving differential equations exist. In this 
project, we introduce the student to a multistep method that takes into 
account previous (and sometimes future!) values of the solution in order 
to calculate the next solution. Multitstep methods of all orders exist 
but we focus on second-order methods for simplicity of formulation [10]. 
Students will need to have some programming knowledge in one of MAT- 
LAB, Maple, or Mathematica in order to make progress on this project. 
We consider the differential equation 


dy 
a eu, oO) = 1 
- 
discussed in Section 2.5. 


Explicit Method: Consider the formula 


h p 
tien =a 5 A Sgr yatie ot (i ha dy NE C2) 


which is used to approximate the solution of the initial-value problem, 
‘= f(x,y), y(ao) = yo. The local truncation error is given by 
Sy) (E)h?, for some &, © (2,45, 2,41). 

1. Using MATLAB, Maple, or Mathematica, implement the above 

formula, known as the second-order Adams-Bashforth formula, an 

explicit method, to approximate the solution at x = 1. Use a step size of 

h = .1 and use the approximate value of y(.1) from Runge-Kutta with 

h =.1 for your value of yj. 

2. Compare the error with that of Euler’s method (a first-order method) 

and the Runge-Kutta method (a fourth-order method). 


Implicit Method: Now consider the formula 


h 
Yi = Vit Fo (jG Veen) 8h) — fai, tia). (2.32) 


i = 1,2,---,N —1, which is again used to approximate the solution of 
the initial value problem, y’ = f(x,y), y(xo) = yo. The local truncation 
error is given by sty (€;)h?, for some €; € (a;~-1, 7441). This is known 
as the second-order Adams-Moulton formula, an implicit method. Note 
here that in order to approximate the solution at y;;1, we need to know 
the value of f(2j41, yi41)! How can this be done? 

1. Substitute the original differential equation for f(x:+41,yi:41) in the 
Adams-Moulton formula. Solve for yi+1. 

2. Using MATLAB, Maple, or Mathematica, implement the resulting 
formula of part 1 with h = .1 again using the Runge-Kutta approxima- 
tion for yy. 

3. Compare the error with that of Euler’s method (a first-order method) 
and the Runge-Kutta method (a fourth-order method). 
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Predictor-Corrector Method: This method combines the explicit and 
implicit methods used above. Instead of solving the Adams-Moulton 
(AM) formula for y;:1, we use the approximate result for y;;1 obtained 
from the Adams-Bashforth (AB) formula. The result of substituting the 
AB result into the AM result usually gives a more accurate answer than 
the original AB answer and is almost always quicker than solving the 
AM formula by hand, as done above. For the instructions below, again 
use h = .1 and the Runge-Kutta approximation for y. 
1. Using MATLAB, Maple, or Mathematica, implement as follows: 

a. Perform one step of AB. 

b. Substitute this value into the AM formula. 

c. Perform one step of AM. 

d. If desired, resubstitute this last AM result into the AM expres- 
sion again. 

e. Compare the results with the AB, AM, and exact solutions. 
This method is called a predictor-corrector method because the AB 
method predicts the function value at x;,, and the AM method corrects 
this with a higher-order approximation. 
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Chapter 3 


Elements of Higher-Order Linear 
Equations 


Following our work with first-order equations, it is natural for us to con- 
sider higher-order equations. The first methods of solving differential equa- 
tions of second or higher-order with constant coefficients were due to Euler. 
D’Alembert dealt with the case when the auxiliary equation had equal roots. 
Some of the symbolic methods of finding the particular solution were not given 
until about 100 years later by Lobatto (1837) and Boole (1859). 


3.1 Introduction to Higher-Order Equations 


While first-order equations are appropriate for certain models, numerous 
others require either at least one higher derivative or at least one additional 
variable to better describe the system in question. We begin our study with 
a definition. 


Definition 3.1.1 

A linear differential equation of order n in the dependent variable y and 
the independent variable x is an equation that is in, or can be expressed 
in, the form 


n m—1 


d d 
dn (a) = + dn—1(2) — +... +.4(z) - +ao(x)y= F(x) (3.1) 
where a, is not identically zero. 
We shall assume throughout that an,a@,-1,...,@9 and F are continuous real 


functions on a real interval a < x < 6 and that 
an(x) £0 for any x ona<a<b. 


The right-hand side F(x) is called the nonhomogeneous term. If F is iden- 
tically zero, then 


n nm—1 


d 
a(t) Go + Oy—i(@) a +... + a(x) + ao(e) y = 0 (3.2) 
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is called a homogeneous equation. It is sometimes called the reduced equa- 
tion of the given nonhomogeneous equation. 


| Example 1 | The equation 


ay dy | 5, — of 
a ee te y=e 


is a linear nonhomogeneous differential equation of the second order. 


| Example 2 | The equation 


d*y Py dy 
3 =0 
ae ae Cae 


is a linear homogeneous differential equation of the third order. 


Existence and Uniqueness of Solutions 

Our goal is to consider methods of solving these higher-order differential equa- 
tions. In particular, we will be interested in second-order linear equations as 
these equations occur often in physics and engineering applications and give 
rise to the special functions we will consider. Before we pursue methods of 
solution, it is best to give an existence theorem for initial-value problems as- 
sociated with a linear ordinary differential equation of order n. 


THEOREM 3.1.1 Existence and Uniqueness 
Consider the linear ordinary differential equation of order n (3.1) where 
An;4n—1,---,@9 and F' are continuous real functions on a real interval 
ax<x%<band 

an(z) #0 for any g ona<a<b. 


If xp is any point of the interval a < x < b and co, c1,...,¢n—-1 are n 
arbitrary constants, then there exists a unique solution f of (3.1) such 
that 


feo =e Calin ag) oes 


and this solution is defined over the entire interval a < x < b. 


What this theorem says is that for the differential equation (3.1) there is 
precisely one solution that passes through the value co at 29 and whose k‘” 
derivative takes on the value cz for each k = 1,2,...,n—1 at x = xo. Further, 
the theorem asserts that this unique solution is defined for a < x < 6. 


| Example 3 | For the initial-value problem 


i d 
i + Tx 7 +a°y =e" with y(2)=1 and y’(2) =5, 
if 
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5 


there exists a unique solution since the coefficients 1,77,x° as well as the 


nonhomogenous term e” are all continuous on (—oo, 00). 
g , a 


SV) Determine if y = cy + cz” gives rise to a unique solution for 
zy” —y' = 0, y(0) = 0,y'(0) = 1 on (—co, 00). 


Solution 
We can easily verify that this is a solution. However, if we simply apply the 
IC, we obtain the two equations 


0=y(0) =a +c2-0? 
1 = y'(0) = 2c -0, 


the second of which gives us the inconsistent statement 1 = 0. What hap- 
pened? A look at the differential equation shows that ao(x) = 0 when x = 0, 
which is the x-value of the initial condition. Thus Theorem 3.1.1 does not 


apply for the initial condition we were given. = 


The theorem has an important corollary in the homogeneous case. 


THEOREM 3.1.2 


Let f be the solution of the n‘”order homogeneous linear differential 
equation (3.2) such that 


(Gy) =U Gy =O) ee Ct) Se 


where Zo is a point of the interval a < x < 6 in which the coefficients 
Qn, Q4n—1,---, 49 are all continuous and a,(a) £0. Then f(#) = 0 for all 
48 (Oi 0) S 4 S (0h. 


| Example 5 | The third-order linear homogeneous ordinary differential equa- 


tion 


dy d*y 
dx dx? 


+y=0 with f(8) = f’(8) = f”(8) =0 


has the unique (trivial) solution f(x) = 0 for all «. - 


We have now talked about existence and uniqueness of solutions. Our goal 
will be to obtain the most general possible solution. We will come up with 
various ways to obtain solutions of the given differential equation but we need 
to know how to find the minimum number of solutions that can be combined 
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to give every possible solution. This is absolutely essential to understand. 
Finding this minimum possible list of solutions that can generate all other 
solutions can be thought of (in a very rough sense) as analogous to finding 
the prime factors of a given integer. This minimum set is known as a fun- 
damental set of solutions and satisfies the property that each element is a 
solution and each “contributes something new” to the set. 


The Need for Sufficiently Different Solutions 


We are now going to consider a case where we can easily obtain a solution and 
use a second example as motivation for studying linear independence and other 
related concepts from linear algebra. Most of the equations we will consider 
in this chapter have y as the dependent variable and x as the independent 
variable. The simplest homogeneous linear equation we have considered thus 
far is first-order, with constant coefficients. It is of the form 


d 
ay il + aoy = 0. 
dx 
What is the form of the solution? In this simple case, we observe that the equa- 
tion is separable and the solution will be an exponential function e(~%/%)*, If 
we consider the second-order homogeneous constant coefficient linear equation 


we ask if it is still possible to have a solution of the form y = e™, since it 
worked in the first-order case. To find the value of r that will make it a solu- 
tion we substitute into the differential equation and find values for r that will 
satisfy the resulting condition. Let’s try this with a specific example. 


| Example 6 | Consider the equation 


dy dy 
2S a Ge Diy tf), ; 
ai t3q, + 2 =0 (3.3) 


If we substitute y = e"”, we have 
ree" + 3re™ 4+ 2e"* —0, which gives e”"(r?4+3r+2)=0. 


Because e”™” is never zero, we consider only the terms in parentheses. This 
equation then gives the conditions for the r-values that make e”” a solution: 


r?+3r+2=0, 


which factors into (r + 2)(r +1) = 0. This holds if r = —1 or r = —2. Thus, 


two solutions to the differential equation are e~* and e~?*. 
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It is not a coincidence that we found two different solutions to this second- 
order equation. We observe that for this situation 


Cie * + C,e-"* (3.4) 


is also a solution, as the reader should check! It turns out that any solution to 
the differential equation (3.3) must be of the form (3.4). Will things always 
be so nice? Let’s try another example to see. 


| Example 7 | Consider the equation 


d’y dy 


If we substitute y = e™”, we see that it will be a solution whenever 
r?+2r+1=0, 


which factors into (r+ 1)? = 0. This holds if r = —1. A solution of (3.5) 
can thus be written as y = e *. Is this the only solution? The answer is a 
resounding “no!” and we observe by substitution that ze~* is also a solution. 
The details of why we might guess xe~* as a second solution are left for dis- 


cussion in Section 3.3. i 


What went wrong in this last example? And how do we deal with such 
situations? To give satisfactory answers to these questions, we first need 
some basic concepts from linear algebra, including an understanding of linear 
independence and linear combination. 


3.1.1 Operator Notation 


We will now introduce some notation to make our subsequent work a bit 
easier. The nth derivative of a function y(x) is given in operator notation 
by 

d” 
Dy = —. 
da” 
Using this notation, the left-hand side of the nth-order linear homogeneous 
differential equation (3.2) 


dq” d™-1 
an(2) Foy + n—a() Gomy t+. Fale) Fo + ao(e) y = 0 
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d 
An (a2) —— + dy—i(2) <—-F tet ay(x) 5 + ao(e)y 


= Gn(x) Dy + Qn_1(z) D™~'y +... +.a1(x) Dy + ag(z) y 


= (an(x) D” + an_1(x) D?™* +... + a1 (x) D + a0(2)) y- 
Thus, we can write (3.2) as 
(an (x) D" + On—i(Z) Daas Pees ay (2) D+ ag(x)) y= 0, 


and in fact we can write the nth-order linear nonhomogeneous equation (3.1) 
as 
(Gn(2) D” + an—1(z) D?~* +... + a1(2) D + ao(x)) y = F(2). 


With this in mind, the following definition is natural. 


Definition 3.1.2 


The expression 
P(D) = ay(z) D” + dn-i1(z) D” * +... + ay (x) D + ag(z), 


where a@n,(X), @n—1(2),...,@0(x) are (possibly constant) real-valued func- 
tions with a,(x) 4 0, is called an nth-order linear differential operator. 


With this notation, we can write an nth-order linear homogeneous differ- 
ential equation compactly as 


P(D)y =0 
and an nth-order linear nonhomogeneous equation as 


P(D)y = F(a). 


VS 9S) Write the differential equation 2y/” — 3y” + 5y’ — y = 2a in op- 
erator form. 


Solution 
The operator is given as 
P(D) = 2D? —- 3D? +5D-1 


so that the equation is 
P(D)y = 2z. 
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pel) Write the differential equation 2ry” — (3x7 +1)y' +e7y = cosx 


in operator form. 


Solution 
The operator is given as 


P(D) = 22D? — (327 +1)D + 


so that the equation is 
P(D)y = cos. 
ss 
Before we proceed with our further study of nonhomogeneous equations, it 
will be of future benefit if we obtain some results for computing with differen- 
tial operators. As we almost always will be dealing with differential operators 
with constant coefficients, we state a few important results with these. 
Let yi and yg both be n times continuously differentiable functions and let 
P(D) be an nth-order linear differential operator with constant coefficients. 
We have 


P(D)(y1 + yo) = (@n D® + @n_1 D?-1 +... +01, D+ a0) (yi + y2) 
= On D” (yi + y2) + Qn_1 D?* (ys + y2) +. 


+a; D(y1 + y2) + ao (yi + y2) 


= On Dy, + an_1 Dy, +... 4.01 Dy + a0 y1 
+an Dy + Gn—1 DP ys +...+ a, Dy2 + ag yo 
= P(D)y + P(D)ys. 
Thus, we have the linearity property 
P(D) (i + ya) = P(D)y1 + P(D)ye- (3.6) 


It can also be shown, but with a bit more effort, that if P,(D) and P2(D) are 
two linear differential operators with constant coefficients, then 


P,(D)P2(D) = P2(D)Pi(D) (3.7) 


so that constant-coefficient linear differential operators commute. It is essen- 
tial to realize, however, that applying an operator to a function is not really 
a multiplication, although it seems like it at times. 


ee BSE) Consider P,(D) = xD, Po(D) = D,y = 3a. Then 


P2(D)Pi(D)(y) = (D)(aD) (3x) = (D)(#D(32)) = (D)(x(3)) = (D) Bx) = 8 
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but 


Pi(D)Po(D)(y) = («D)(D) (3x) = (#D)(D(32)) = (xD)(3) = x(0) = 0. 


We again stress that the order can be exchanged only in the case of differ- 
ential operators with constant coefficients. To see this in general, we write 


P,(D)P:(D) 
= (an D” + an—1 D®~* +... +41 D +49) (bn D” + bn-1 D"! +... + bo) 
= Gate) DD?” + (Qn—1by + (a0 
+(@n—aby + Gn—i1bp—1 + Gnba_2)D?? +--- 
+(anbo + Gn—1b1 + dn—2bg + +++ + dabn—2 + Gibp_-1 + apbn)D” +--- 
+(agbp + a,b + agb2)D? + (abo + a9b1)D + agbo 
= (bpa,)D™ + (6,149 + baagi)D™* 
+(by—90m + bp 1Gn—1 + bpGnse) D7"? +--: 
+(0ndo + bp—1a1 + bn—2ag + +++ + b2Gn—-2 + b1Gn—1 + boan)D” +--- 
+(bea9 + bya, + boa2)D? + (by, a9 + bpa1)D + boa 
= (by D” + by) D?™1 +... +00) (an D” + Qn_1 D" | +... +a, D +9) 
= P>(D)P,(D). (3.8) 


It is left as an exercise to use sigma notation to show this property in a 
more elegant fashion. With the property P;(D)P2(D) = P2(D)P;(D), we see 
that we can always factor a constant-coefficient linear differential operator 
into powers of first-order terms, just as we would a polynomial, as long as we 
allow the use of complex numbers. Allowing for complex roots will be essential 
in finding the solutions of constant-coefficient homogeneous linear differential 
equations. The properties of the differential operator will also be essential 
when studying the Annihilator method for solving certain constant coefficient 
nonhomogeneous differential equations; see Section 4.3. 


| Example 11 | The linear differential operator 
P(D) = D*+5D? + 6D? 


can be written as 


P(D) = D?(D? +5D +6) = D?(D + 2)(D +3). 
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Note that it could also be written as P(D) = (D+2)(D+3)D?, for example, 
since the factors commute. 


is] 
| Example 12 | The linear differential operator 
P(D) =D? +9 
can be written as 
P(D) = (D + 3i)(D — 32). 
33 


| Example 13 | The linear differential operator 


P(D) =D? +2D+4+2 


has roots —1 +7 and thus can be written as 


PO Cis = C=) = (21 -piosi si), 


In practice we will usually not need to factor the operator completely into 
linear factors but it is conceptually important to realize that we, in fact, are 
able to do so. 


| Example 14| 14 Apply D? + 3 to the function 


f(z) = x* — cosa. 
We apply the operator to this function to obtain 
(D® + 3)(f(x)) = D’ f(x) + 3f(x) = f(x) + 3f (a). 


We thus need to calculate the second derivative of this function. Taking two 
derivatives gives 


fi(c)=4e?4+sinz, f(x) = 122? + cosa. 
We thus obtain 


f(z) + 3f (x) = (122? + cosx) + 3(2* — cos z) 
= 37 + 122” — 2cosa. (3.9) 
@ 


The operator notation is useful for writing differential equations in compact 
form and we will see that it will be especially useful in the next section. 
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Problems 


In Problems 1-5, determine whether the differential equation is guaranteed 
to have a unique solution passing through the given initial condition. Then 
try to find constants to make the proposed function y a solution to the IVP. 


y" — 4y = 0, y(0) = 4,y/(0) = 
Ly” +y' =0, y(0) =0,y/(0) = 1, y”(0) = 0; y= ci + cgcosx +c sina 
. cy” — 2xy’ + 2y =0, y(0) = 


2 

3 0, y’ (0) = Osy = cia + cox? 
4. x?y" — zy’ — 3y = 0, y(0) = 

5 


1. 0; y = cye2” + cge7** 


uy 0,y'(0) =O; yaas?+2 
. xy" — 6ary' + 12y = 227, y(0) = 0, y'(0) = 0; y = 2? + coat + 2? 


In Problems 6-13, find all values of (x,y) where Theorem 3.1.1 guarantees 
the existence of a unique solution. 
6. y" 4+ 32y' + y =sine 


7. cy" + 327y = sing 


8. yl" by! 4 6y = _ cosx 9. y) + dy" + 4x?y = et 
10. y” + 6y/ ade: 6° a 11. y"” +32y' +r2y=Ine 
12. (aw — 1)?y" + 5(a? — 1)y’ + 6y=113. y” +3(tanz)y +r2y=2 


In Problems 14-19, apply the given differential operator P(D) to the func- 
tions and simplify as much as possible. 


14. P(D) = D—5; fi(a) = 32+ 7, fo(x) =cosz, f3(x) = e* 

15. P(D)=D+1; fifa) =e, fo(x) =4+ sing, f3(x) =e” 

16. P(D) = D? —1; fi(x) = 4e~* +e", fo(x) = 23 +4, f3(x) =e” —5e* 

17. P(D) = D? +1; fi(x) = 2? + 22, fo(x) = cos +sinz, f(x) = sin 2x 

18. P(D) = D? —4D +5; fi(z) = e?* cosz, fo(x) = 4a? + e”, f(x) = 
x® — cos 2x 

19. P(D) = D?+2D +1; fi(x) =e", fo(x) = xe~*, f3(x) =sing 

In Problems 20-27, calculate P(D)Q(D)(y) and Q(D)P(D)(y). Compare 


the results. 


20. P(D) = D,Q(D) = D+32, y=2r¢41 

21. P(D) = D,Q(D) = D+ 3a, y=sinz 

22. P(D) =D,Q(D)=D+z2,y=e" 

23. P(D) = D,Q(D) =D+2,y=1+cosz 

24, P(D) = D? — D,Q(D) = D3 + 2D, y = «6 — 22? 
25. P(D) = D-1,Q(D)=D?+D-3,y=2? +sinz 
26. P(D) = D?+2D+2,Q(D)=D+1,y=e" 

27. P(D) = D?+2D+2,Q(D)=D+4+1,y=2°4+ 52 
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28. (a) Use the commutative property of the constant coefficient differential 
operator to quickly evaluate D3(D — 2)(D +3)(a? — 2x +7). 
(b) Use the linearity property of the differential operator to quickly eval- 
uate D3(a? — 5 + €?”). 


In Problems 29-34, factor the operators into linear factors and/or irreducible 
quadratic factors. 

29. D? - D—6 30. D4 — 2D? +1 31. D*+2D? +1 

32. D? — D? +4D 33. D> —1 34. D? +8 


In Problems 35-40, rewrite the following differential equations using operator 
notation and factor completely. 

35. y"” + 10y’+16y=0 36. y"+3y'—-4y=0 387. y/" + Gy" + Dy’ =0 
38. y) + 4y” + 4y’ = 0 39. y'” — 8y =0 AO. 9" + 27y =0 


Al. Use sigma notation to show that the constant-coefficient differential op- 
erator commutes. That is, let 


PO)=) eal" wd ADH) tad 
i=0 1=0 


and show that P,(D)P2(D) = P2(D)P,(D). 


3.2 Linear Independence and the Wronskian 


Our discussion of topics from linear algebra will deal with both general 
functions as well as solutions of differential equations. The interplay between 
linear algebra and differential equations is a rich one and we encourage the 
reader to embrace it. In the ensuing discussion, we will not assume that the 
reader has had a course in linear algebra. The reader may find it useful to 
read Appendix B.1—B.2 for an introduction into the subject of linear algebra. 

Now we will borrow some terminology from linear algebra. 


Definition 3.2.1 
If fi, fe,.--, fm are m given functions and cy, ¢2,...,Cm are m constants, 
then 


cifitecafet...+enfm 


is called a linear combination of fi, fo,..., fm- 


Our goal is to tie this in with our study of differential equations and this is 
done with the following theorem: 
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THEOREM 3.2.1 
Let fi, fo,---, fm be any m solutions of the homogeneous linear differ- 
ential equation (3.2), then 


Cidin a QYie ar oso aP Cralian 


is also a solution of (3.2) where cy, c2,...,Cm are arbitrary constants. 


Thus, this theorem gives the useful fact that any linear combination of 
solutions to (3.2) is a solution to (3.2). 


| Example 1| Consider the differential equation 


dy 
5 +y=0. 
dx2 | 4 
We note that yi(v) = sinx and y2(x) = cosa are solutions. (Check it!) 
Thus, 
y(x) = cy sina + cg cosa 
is also a solution for any constants c, and cz. (Check this, too!) a 
We have found that solutions exist and are unique. We also know that any 
linear combination of solutions of a homogeneous linear differential equation 
is still a solution. The question is: When we have solutions to (3.2), how do 
we know when we have the most general solution? To answer this, we need 
to introduce some additional concepts from linear algebra. 


Definition 3.2.2 
The n functions f;, fo,..., fn are linearly dependent on a < a < b if 
there exist constants C1, C2,...,€n, not all zero, such that 


ci fi(z) ae C2 fa(x) SP oce Sr GruliaD) = (0) 


for all x such that a < a < b. We say that the n functions f1, fo,..., fr 
are linearly independent on a < x < b if they are not linearly dependent 
there. That is, the functions fi, fo,..., fn are linearly independent on 
@Se2< oi 

ci fi(x) ar C2 fa(x) SP coe AP Crane) = (0) 


Hore Ell a Siren nek aS ae << (Thanos = En = ooo = EG = 0. 


| Example 2 | The functions x and —3z are linearly dependent on 0< a4 <1 


since there are constants c, and c2, not both zero, such that 


1x + Co(—3x) = 0 
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for all zw onO0<a< 1. Just take c, = 3 and c = 1. = 


| Example 3 | The functions e” and 2e” are linearly dependent, since 


—2-(e”) +1- (2e”) =0. 


The constants are c) = —2 and cg = 1. = 
| Example 4 | ~ Show that x and 2? are linearly independent on -1 <a <1. 
Solution 
To see this, we show that 

cu + cox? = 0 (3.10) 


for all x on 0 < x < 1 implies both c; = 0 and cg = 0. 
Since the equation holds for all x, it must hold when x = 1. This gives 


c1(1) ae c2(1)? = 0. 
It must also hold when x = —1 and this gives 


c1(—1) ar e(—1)? = 0. 


Solving the second equation gives c; = cg and substitution into the first gives 
2C2 = 0, 


which only holds when cz = 0. Thus we also have c; = 0. Hence x and x? are 
linearly independent on 0 < a <1. ia 

In the previous example, we note that we could have chosen any number 
of x-values except x = 0. This is because both functions are zero at 7 = 0. 
Determining whether a set of functions is linearly independent can sometimes 
become cumbersome by using the definition if there are many functions to 
consider. Sometimes it may be useful to use our computer software packages 
to determine the values of the coefficients and we now illustrate this. 


Determine whether f, = 1+ 32, fo = 4-227, fg = 5x — 2? are 
linearly independent on the real line. 


Solution 


We need to see if 
Ci: fi + Co fo + c3f3 =0 forall x (3.11) 


can only happen when c; = cz = cz = 0. We can rearrange (3.11) by grouping 
like powers of a: 


(c, + 4cg) + 2(3c1 + 5e3) + 2?(—2c2 — 3) = 0. (3.12) 
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Since this holds for all x, by assumption, we must have the quantities in 
parentheses equal to zero: 


Ci =F Aco =() 
3c, TF 5C3 = (0 


—2c2 -o = 0. 


We want to see if there are non-zero c-values that will make this set of equa- 
tions true. This simply means we need to solve the equations simultaneously 
and our computer packages can do this quickly (see the end of the chapter). 
Regardless of the program (or if we did it by hand), we see that the only way 
for (3.11) to be true is when cy = cg = c3 = 0. This shows that the functions 
are linearly independent for all x-values. = 

With this additional concept of linear independence, we can give the fol- 
lowing theorem. 


THEOREM 3.2.2 

The n*” order homogeneous linear differential equation (3.2) always pos- 
sesses n solutions that are linearly independent. Further, if f1, fo,..., fr 
are n linearly independent solutions of (3.2), then every solution f of 
(3.2) can be expressed as a linear combination 


Cifi(x) + cofo(z) +...+ ¢rfn(x) (3.13) 


of these n linearly independent solutions by proper choice of the constants 
C1,€2,---,€n. The expression (3.13) is called the general solution of 
(3.2) and is defined on (a,b), the interval on which solutions exist and 
are unique. 


We thus have that the solutions f1,..., f, can be combined to give us any 
solution we desire. Could another set of n functions also work or is this set 
unique? Actually, any set of functions that satisfies the following three con- 
ditions will work and we call the set a fundamental set of solutions of (3.2). 


Three Conditions of a Fundamental Set of Solutions 

1. The number of functions (elements) in this set must be the same as 
the order of the ODE. 

2. Each function in this set must be a solution to the ODE. 

3. The functions must be linearly independent. 


We again note that a fundamental set of solutions is not unique. In order 
to obtain a fundamental set, we may need to add or remove functions from a 
given set. Once we have a fundamental set of solutions, we can construct all 
possible solutions from it. 
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What remains now is to determine whether or not the n solutions of (3.2) are 
linearly independent. This is necessary in order to determine a fundamental 
set of solutions. 

The following definition is for n general functions and does not assume the 
functions are solutions of a differential equation. 


Definition 3.2.3 


Let fi, f2,---;fn be m real functions each of which has an (n — 1)* 
derivative on the interval a < 2 < b. The determinant W(x) = 
filz) fax) —«s- fn (x) 


file) falz) —... fn(2) 
: rae , in which 


Wino) son) (2) = 


n—1 , n—1 > n—1 
fi Gt eG) 
primes denote derivatives, is called the Wronskian of these n functions. 


The determinant is a useful concept in linear algebra. The formulas for 
calculating it are straightforward but very computationally expensive (i.e., it 
takes a long time to do it). A general formula for the determinant exists but 
we will just state it for the “2 x 2” and “3 x 3” cases: 


a b 
: i = ad — bc (3.14) 


and 
a, a2 a3 
by bo bs = ay (bec3 = b3c2) = a2(bic3 = b3c1) + a3(b1C9 = bec). (3.15) 
Cr. C2 & 
We refer the reader to Appendix B for a more thorough introduction to 
determinants. 
From the formula for determinant, we observe that 


W(z) = W( fis fays+5 fn)(Z) 


is a real function defined on a < x < b. 


THEOREM 3.2.3 

Let fi, fo,.--,; fn be defined as in Definition 3.2.3. 

1. If W(ao) 4 0 for some zo € (a,b), then it follows that fi, fo,..., fn 
are linearly independent on (a, b). 

2. If fi, fe,..-,fn are linearly dependent on (a,b), then W(a) = 0, for 
all x € (a,b) 


We note that this theorem does not say that “if W(x) = 0 for all # € (a,b), 
then the f;(x) are linearly dependent.”! This last statement will only be true 


1We also note that part 2 of this theorem is just the contrapositive of part 1 and hence 
equivalent to it. But we list both for emphasis. 
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over some restricted domain; see Problem 19. To show linear dependence of 
functions, we must use the definition. However, if the functions under con- 
sideration are solutions to a differential equation, then linear dependence is 
much easier to determine, as this next theorem shows. 


THEOREM 3.2.4 

Let fi, fo,.--, fn be defined as in Definition 3.2.3. Suppose that the f; 
are each a solution of a given linear homogenous differential equation of 
order n. Then exactly one of the following statements is true: 

1. W(x) 40, for all x € (a,b) 

2. W(ax) =0, for all x € (a,b) 

Moreover, W(x) 4 0 for all a € (a,b) if and only if the {f;} are linearly 
independent on (a, 6). Similarly, W(x) = 0 for all x € (a,b) if and only if 
the {f;} are linearly dependent on (a, b). 


Note that this theorem tells us that if we have solutions of the same differen- 
tial equation, we only need to check the Wronskian at one point in order to 
determine whether the set is linearly dependent. The previous theorem thus 
gives us an “easy” check for both linear independence and linear dependence 
in this case. We show its usefulness with an example. 


d 
SESS) We have seen that sinz and cos are solutions of i +y=0. 
L 


Given our discussion, we should ask if the two functions are linearly inde- 
pendent. To check this, we calculate the Wronskian: 


sinx cosz 


W (sin x, cosa) = : 
COS © — SIN 


= —sin? x — cos’? x 
= —(sin? x + cos? x) 
= —1 #0 for all real x. 


Thus, sina and cos are linearly independent and so are a fundamental set 
of solutions to the differential equation and 


y(x) = cy sina + cg cosa 


is the general solution. - 


As mentioned previously, W(x) can show the linear independence of func- 
tions, even if they are not solutions of a differential equation. Table 3.1 gives 
a summary for checking linear independence (or dependence) of a set of func- 
tions. 
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Table 3.1: Showing Linear Independence of Solutions vs. Functions 


Solutions of Same ODE | General Functions | 


Linearly by definition or show by definition or show 
Independent | W(a) 4 0 for some x W (a) £0 for some x 
Linearly by definition or show 


Dependent | W(a) =0 for some x by definition only | 


Note that the entire column under “Solutions of same ODE” could also 
read “for all x” since the two are equivalent by Theorem 3.2.4. 


| Example 7 | Show the functions e”, e~*, and e?” are linearly independent. 


Solution 
If we calculate the Wronskian W (a) we have 


e” e € 
W (e?,e~”, e?”) = |e% —et 2e2% ; 
e, €-" Ae?” 
which is expanded as 
W(e*,c 7,6") =e e* De” e” re te oer 
: , et 4e?® e® de?” e*~e * 


= —6e2* # 0 for all real x. 


We could have also tried « = 0 (for example) to see that the Wronskian was 
non-zero. The only drawback for “guessing” values if we want to show linear 
independence in the case when we do not have solutions is that an answer of 
zero at a specific z-value tells us nothing. in 

It would be simple to try other values of « for which we wanted to sub- 
stitute. This would be useful as the following example shows the potential 
problem of guessing values of x that may give a non-zero value for the deter- 
minant. 


| Example 8 | =) Determine whether the functions sin2z and sinz are linearly 


dependent or independent by using the Wronskian. 


Solution 
We can calculate the Wronskian as 


sin 2x sin x 


W(a) = 2cos2x cosxz 


(3.16) 
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We can easily check that W(0) = 0, which doesn’t help. W(7) = 0 as well. 
We might be tempted to stop guessing and switch to a check by definition, but 
“wise” guessing shows that W(7/2) = 2. Thus the two functions are linearly 
independent. 

|_| 

While it may be easier to substitute an x-value into the matrix and then 
calculate the determinant, this is not recommended when you have access to 
one of the programs. As can be seen in this example, it is just as easy to 
calculate W (a), especially if we use MATLAB, Maple, or Mathematica. 

We note that the problem that arose here is that the functions are both 
zero at the same point. We simply need to evaluate the functions at places 
where they (i) don’t intersect tangentially or (ii) aren’t zero at the same 
point. Neither of these problems occurs with solutions of linear, homogeneous 
second-order differential equations because the uniqueness theorem disallows 
any intersections of solutions. And again we point out that it is often useful 
to have our computer software packages available to aid us in trying to un- 
derstand the course material. 


Problems 

1. Show that x and 22 are linearly dependent on [0, 1]. 

2. Show that e?” and xe?” are linearly independent for all x. 

3. Show that e” and x + 1 are linearly independent for all x. 
4. Show that sinz and z are linearly independent for all x. 
5 


. Show that if y, and yp are solutions of the first-order differential equation 
y’ + p(a)y = 0 then y; and ye are linearly dependent. 


In Problems 6-18, determine whether the following sets of functions are lin- 
early independent for all « where the functions are defined. 


6.{e",6°°") 7. {sin 2x, cos 2x} 8. {x3 — 4,2, 3x} 

9. {x? — 4x, x, 2x7} 10. {fz —42,2,2/fr} 11. {x, 2x — 2,2 4 3} 
12. {2? —3,a°— 32,2} 138. {e*,e-*,1} 14. {23,1 — <2} 

15. {14+ 27, 2,27} 16. {x?,0+ 2,2? — 2-1} 

V7 .feje 2") 18. {o,6°*"*,2""-* 


19. Consider the functions f; = 2, fo = |a|. 
(a) Show that {f1, fo} is linearly dependent on [0, 1]. 
(b) Show that {f1, fo} is linearly dependent on [—1, 0]. 
(c) Show that {f;, fo} is linearly independent on [—1, 1]. 
(d) Show that W (a, |x|) = 0 for all x. 
Thus we have found a set of functions, {2, |a|}, whose Wronskian is always 
zero even though the set is linearly independent. 
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20. Repeat (a)—(d) in Problem 19 for the functions f; = 2°, fo = |2|%. 


In Problems 21—23, verify that the given function is a two-parameter fam- 
ily of solutions to the given second-order ODE. Determine whether this 
solution can give rise to a unique solution that passes through the given ICs. 
Does this violate the existence and uniqueness theorem? 

21.y= ee ene, 0<2<0o, xy” — ay +y=0; y(1) =3, y/(1)=-1 
22.y=cC t ean", zy” —y' =0 on (0,00); y(0) = 0, y/(0) = 1 

23. y = cz" + coz, x7y" — 2ary’ + 2y = 0 on (—00, 00); y(0) = 3, y/(0) =1 


In Problems 24-33, show that the given set of functions forms a fundamental 
set of solutions to the differential equation on (—co, 00). 


24. {3+2,2-52}, y” =0 25. {4,2 —1}, y” =0 

26. {sin 2x, cos 2x}, y” + 4y =0 27. {e277 e8*}, y” —y' — 6y =0 
28. (277 2°" 1, i Ty +10y=0 29. {e~3*, e7/7}, Qy” + 5y/ — 3y = 0 
30. {e*, xe}, y” — 2y’+y=0 31. {1,cosz,sinz}, y/” +y' =0 


32. ie = e781, yf"! + 3y" + 2 =0 
33. {1,cosz,sinz,xcosz,zrsinx}, y +2y!” +y/ =0 


In Problems 34-51, determine whether the given set forms a fundamental 
set of solutions to the differential equation. Take the interval to be (—oo, co) 
unless otherwise stated. Clearly state your reasons for your answers. 


34. {z,e"}, y’ +y =0 35. {27 +4,5-—c}, y”+y=0 
36. {sin 2x, cos 3x}, y’”” + 4y = 0 37. {sinz,e"}, y” —y=0 
38. {1,87}, y” — 3y’ =0 39. {sinz —5cosz,3sinz}, y’ +y =0 


40. {sin 5a + cos 5x,cos 5a — sin 5a}, y” + 25y = 0 

A1. {a?,2,e-7}, y (x) — w(x) =0 42. {e4*, e?7}, y” — by’ + 8y =0 

43. {e~*,xe~*}, y" + 2y’ +y=0 44, {e~*, ze 37}, y"” — Gy’ + Vy = 0 

45. {x,3,e7}, y” —y"” =0 46. {3, e7*, e?7 + 2}, yl” — 4y’ =0 

47. {e~7* sin z, e~7* cos}, y” + 4y’ + 5y =0 

48. {2° x~1}, oy "+ 6xy’ + 12y =0 on (0,00) 

49. {x3 x}, xy — 6ry’ + 12y = 0 on (0, 00) 

so {12 ay zy” + 5zy’ + y = 0 on (0,00) 
Jr x x 

51. {e-*,e*, xe, ze*}, yO — 2y"” + y =0 


3.3. Reduction of Order—the Case n = 2 


In this section we develop a method of simplifying an nth-order differential 
equation if we already know a solution. The following theorem is useful. 
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Definition 3.3.1 


Let yi be a solution of the nth-order homogeneous linear differential 
equation (3.2), with y, 4 0 for all x € (a,b). Then the transformation 


yo = yi(x)v 


reduces (3.2) to an (n — 1)st order homogeneous linear differential equa- 
tion in the dependent variable 
du 
i= —. 
dx 


This result is very useful, for if we know one nontrivial solution then we 
can reduce the order of the differential equation. 
We will consider this theorem for the case with n = 2. Suppose yj; is a 
known, nontrivial solution of the second-order homogeneous linear equation 
d? d 
a(x) + ar(z)— + ao(x)y = 0. (3.17) 
dx? dx 
Let yo = yiv where y; is the known solution and v is a function of « to be 
determined. 
Taking derivatives and simplifying gives 


dy2 dv ; 
de ae TY 
and 2 F F 
Y2 U , dU ” 
Fee es Qy,!— v. 
Ge ge ee 


a d d 
a2(x) Wo oy — +y1"v | + a1(2) y1— +y1'v ) +ao(x) yiv =0. 
dx? dx dx ee 
——=>—=— ————— yo 
Yo Yo 
Rearranging the terms then yields 
dv du 
a2(X)y1 > + (2a2(x)y1' + a1(x)y1) i: 
+ (a2(a)yr” + ai(x)ys" + ao(x)y1)v = 0, (3.18) 
ee 


— 1) 
where the coefficient of v is zero because we assumed that y; is a solution of 


d? d 
a + ay (2) <2 + ao(x)y = 0. 


ag (x) ae 
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So the Equation (3.18) becomes 


a? d 
a2()yn 5-5 + (2aa(e)yn’ + a (e)yn) 5 = 0. 


We now make the substitution 


dv 


and obtain the first-order homogeneous linear differential equation 
az(x)yiw' + (2a2(x)yr' + a1 (x)y1) w = 0. 


This equation is separable and you can show that 


cexp |-J er dx| 
Yi (x) 


w(x) = 


is the solution. By (3.19), we have ve = w and thus integrating gives us 


v= cf i [- J ma a dx 


y7 (2) 


and we only need the constant c to satisfy c 4 0. We also have yo(x) = 
yi(a)v(a) and thus 


exp [- t a) da 
y= ne | aCe) dx (3.20) 
Yi 
is a solution of the differential equation (3.17). 

Recall that our goal is to find two linearly independent solutions to (3.17). 
We assumed that y; is a solution and we showed that y2 defined in (3.20) is a 
solution. We can show that the solutions y; and ye are linearly independent 
by considering their Wronskian: 


HT! = yiye’ — yon’, 
where 
exp [-J an(2} do exp |-J ate dx| 
yo (x) = yi € F YL ef dx. 
yi (2) y} (2) 
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Substituting in for y2 and yo’ in the Wronskian gives 


exp |- J a 2 de] +m’e | exp [- ek 1 2 dar a 
Yy 


yiy2’ — yoy’ = yi | yie at 
yi (a) ) 


exp [- f 4a 7 
7 ne | ye(a) 


Y2 
; exp |- a dx| 
= yj (x cf 5 da 3.21 
a Ra) — 
# 0. (3.22) 
Thus yi and yz are linearly independent and the linear combination 
exp [— f 24az] 

ciyi + c2y2 = ciyi + ane | dx (3.23) 

y7 (x) 
j : oo |S case] d (3.24) 

= ciyi + Cay x : 
1Y1 + C21 va) 


is the general solution of (3.17) where G2: = cg ¢. 

While equation (3.24) gives you the general solution, please check with your 
instructor as to whether you should apply it or go through the derivation of 
it. In the next two examples, we take the latter approach. 


| Example 1 | Given that y, = e?” is a solution of 


find a solution that is linearly independent of y; = e?” by reducing the order. 


Solution 
Let yo = ve"; this gives 
dy2 on dU d? yo on AV 


—_ palade 9 22 = 
dx nl ra one: and dx? : dx? dx 


Substituting these derivatives gives 


? dv a 
G 7a + 47 iz + 10) + (we + 220) — 6 (e**v) =0. 
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This simplifies to 


d?v dv 
22 2x 
— +5 = 0. 
dx? = dx 
Now let w = = so that 
d 
2x 7 + 567% w = 


This last equation is separable with solution w = ce~°*. 


We now choose a specific c-value to obtain the particular solution. For 
example, choosing c = —5 gives 


dv = —5eo® 
dx : 
Integrating gives v(a#) = e~°*. Thus, 
yo = ect _ e2% e— bt e738 
and the general solution is 
y = ce" + cge 3”. 
|_| 
We note that choosing c = —5 in the previous example only made our in- 


tegral “nice.” If we chose, for example, c = 1, we still would have obtained 
an equally valid solution since we ultimately multiplied the second solution 
by a constant cz. Reducing the order of the equation works on any linear 
homogeneous equation, even if the coefficients are not constant as we will see 
in the next example. 


| Example 2 | Given that y; = x is a solution of 


a d 
(2? +155 — 20 +2y =0, 


find a solution that is linearly independent of y; = x by reducing the order. 
Solution 


We see that y; = x is indeed a solution, since y{ = 1 and y// = 0 so that 
substitution gives 


Bo TL 


Substituting these derivatives gives 


d*y dv dv 
(x? +1) (eS =) 2x (eZ | v) + 2xv = 0, 
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which implies 


d-v du 
2 - 
Now let w = # so that 
dw 
241)— +2w =0. 
x(a + lia w=0 


This equation is separable. After we separate the variables we have 


1 —2 22 2 
d = d = ——————( — — d A 
we x(a? + 1) = (5 =| " 
where the last equality results from the partial fraction expansion. We then 


integrate and solve for w to obtain 


_ e(z? +1) 
=. 


ax 
We again choose a specific c-value to obtain the particular solution, say 
c = 1, and obtain 


Integrating gives v(#) = « — —. Thus, 
x 


1 2 
Y2 LU x (« ) x 


So the general solution is 


y = 2 + c2(x? — 1). 


Problems 


In Problems 1-18, use the given solution to reduce the order of the differential 
equation. Use the methods of Chapters 1, 2, and Section 3.1 to solve the 
reduced equation. 


1.y” —2y’+y=0, y1 =e" 2. y" — 8y' + 16y = 0, yw. = e**” 
3. y” — 6y' + 9y = 0, y. = e** 4. Ay" + 4y' + y =0, yy =e?” 
5. 2y” + 5y’ — 3y =0, y, =e"? 6. y” —9y = 0, y. = e**” 

7.y" +25y = 0, y. = cosda 8. cy" —y' =0,y=2° 
9.ay"+y' =0,y.=Inx 10. 27y" — zy’ — 3y =0, y = 2? 


11. 2?y” — zy’ +y=0, y =2lnz 

12. (2 + 1)?y" — 3(a + Ly’ +3y=0,y, =2+1 

13. (20 + 1)y” — A(@ + Ly! + 4y = 0, yn = €** 

14. (2? — 1)y” — Qay’ + 2y = 0, y) = 27 +1 

15. y!” — 2y" —y' + 2y =0, y. =e7* 16. y/" + 5y"” =0, y = 2 

17. y" — 4y" + 5y’ — 2y = 0, y, = e? 18. y!” —5y” +. 8y' —4y = 0, y: = xe?” 
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19. Show that the separable differential equation 
a2(x)yiw' (x) + (2a2(x)y1' + a1(x)y1) w(x) = 0 


has solution 


20. Show that if y; is a solution to the differential equation 


dy 
dx? 


d 
ay(x) + ao(x)y = 0 


a(x) 


and y2 is another solution given by 


exp - J eae dx| 
Yy2= ne | dx, 


then {y1, y2} forms a fundamental solution set. 
21. Consider the hyperbolic functions 
e+e * ee, 


cosh xz = a ands sinha = 5 


Show that 


a) is cosh x = sinha. 
x 


b) 7 sinh « = cosh. 


( 

( 

(c) cosh? x — sinh? x = 1. 

(d) cosha and sinh are linearly independent functions. 
(e) A general solution of y’’ — y = 0 is 


y =c,cosha + cgsinha. 


3.4 Numerical Considerations for nth-Order Equations 


Although we will learn how to solve nth-order homogeneous equations that 
have constant coefficients in Section 3.6, we will often encounter situations 
where the coefficients are not constant. In addition, sometimes it will be diffi- 
cult to exactly find the roots of the characteristic polynomial that arises from 
our differential equation. In both of these situations, we still need to know the 
behavior of the solution and it is often helpful to calculate this solution numer- 
ically. The method we learn in this section also applies to nonlinear equations 
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and this will be useful in later chapters (and real life!). The methods that 
we learned in Section 2.5 have analogous formulations in higher dimensions, 
with the Runge-Kutta method still being the much preferred method. We will 
not go through the details of this method again, but will refer the interested 
reader to many of the texts given in the References, e.g., Burden and Faires 
[10]. Instead, we will show how to use MATLAB, Maple, and Mathematica to 
calculate solutions of an nth-order equation. For the Maple and Mathematica 
code, if we want to plot solutions in the z-y plane we only need to change the 
equation that is input. For the MATLAB code, we will also need to change 
the m-file containing the equation. (This will be necessary for MATLAB, 
Maple, and Mathematica when we want to plot solutions in the y-y’ phase 
plane. But first we will need to reduce the nth-order equation to a system of 
n first-order equations.) 
For both implementations we will consider the two differential equations: 


Qry" (x) + x? y'(x) + 3x%y(x) = 0, y(1) = 2, y’(1) =0 (3.27) 

and 
yO (a) + 2?y'(x) + y(a) = cos(x), y(0) = 1,y'(0) = 0,y"(0) =0,y"(0) = 1 
(3.28) 


In both cases, we will want to plot the solution from the initial x-value until 
x = 5 using a step size of h = 0.05. We will also give the approximate solution 
at the value x = 5. 


Converting an nth Order Equation to a System of n First-Order 
Equations 

We said that we will skip the details of the Runge-Kutta method for nu- 
merically solving higher-order equations. But we will briefly discuss how the 
method is applied. For a first-order equation, Section 2.5 showed how we con- 
sidered four different slopes of the direction field in our efforts to calculate one 
step. For a second-order equation, we will convert our differential equation to 
the form 


ut = f(a, ui, U2) 
Uy = g(x, U1, U2). (3.29) 


In doing so we then see that we can carry out the first-order Runge-Kutta 
calculation in each variable. Thus we now have two directions to worry about 
besides the independent x-direction. But the idea is exactly the same as 
before—we will still consider four different slopes of the direction field (now 
three-dimensional!) in order to take one step. The direction field, as you 
might imagine, gets rather ugly and it is hopeless to even attempt to draw it 
for a third- or higher-order equation. 

The obvious question is “how do we go from a second-order equation to 
something of the form of (3.29)?” Let us consider the equation 


ag(a)y" + ai(a)y! + ao(x)y = F(a) (3.30) 
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as our second-order equation that we would like to convert. We need two 
variables, u; and u2. We then set uy = y and ug = y’. The left-hand sides of 
(3.29) are taken care of and we need to relate the right-hand side to (3.30). 
We have 


but need to write the right-hand sides in terms of our new variables. The 
first equation is simple enough—y’ is the same as uz. What is y’”? Well, we 
can solve the original equation (3.30) for y” and then substitute. That is, we 
write 


1 


y= 7 ale)y! — olay + F(@)). 


The right-hand side still needs to be put in terms of the new variables and we 
substitute uy = y and ug = y’ to obtain 


tio = ~ (—a1(x)u2 — ao(x)ur + F(ax)). (3.31) 


If we were given initial conditions, these could be converted to give u;(29) = 
yo, U2(Lo) = yi. The situation is analogous for a higher-order equation. 


How to convert an nth-order ODE into a system of n first-order 
equations 


(1) Introduce the same number of variables as the order of the equation. 
Rename the Oth through (n — 1)st derivatives of the function. 


(2) Solve the original nth-order equation for the highest derivative, 
(n) 
Yy é 


(3) Write the first derivative of each new variable as the left-hand side 
of an equation (you will have n equations). Then rewrite the cor- 
responding right-hand sides in terms of the new variables. 


We can always convert an nth-order equation to a system of first-order 
equations but we cannot always easily take a general first-order system and 
make it into an nth-order differential equation. And although we illustrated 
this conversion with a linear equation, we can actually convert any nth-order 
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equation to a system of n first-order equations, provided we are able to solve 
for the highest derivative (i.e., perform Step (2)). Before giving two exam- 
ples of the above method, we mention that u; is the solution of the original 
nth-order equation. This will be useful when we want to plot the solution. 
As a bonus, we also will have n — 1 derivatives of this solution. For physical 
problems, for example, it may be useful to have both position and velocity as 
functions of the independent variable time. 


|Example 1, Reduce the equations in (3.27), 

2xy" (x) + 2°y'(x) + 3a°y(x) = 0, y(1) = 2,y'(1) = 0, 
to a system of first-order equations. 
Solution 


We are given a second-order equation and thus we will obtain two first-order 
equations. We solve for the highest derivative to obtain 


Uy = U2 — —uU1. (3.32) 


The initial condition then becomes ui(1) = 2, u2(1) = 0. - 


| Example 2 | Reduce the equations in (3.28), 


y (x) +.27y! (x) + y(x) = cos(x), y(0) = 1, y'(0) = 0,y"(0) = 0,y"(0) = 1, 


to a system of first-order equations. 


Solution 

We have a fourth-order equation and thus we will have four first-order equa- 
tions. Although this system is not homogeneous, this will not affect the steps 
we take. We solve for the highest derivative to obtain 


yO = —27y! (x) — y(«) + cos(2). 


We then set ur = y, ug = y’,u3 = y”, us = y’”’. Our system of first-order 
equations is thus 
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ul = U2 
Ub = Us 
Uy = Ud 
uy = —2@7 ug — us + cos(z). (3.33) 


The initial condition then becomes u1(0) = 1, u2(0) = 0, ug(0) = 0, v4 (0) = os 


Problems 


There are three parts to each of these problems: (i) convert the equations in 
Problems 1-16 to a system of first-order equations (do this part even if your 
software allows you to type in the equation without having to first convert 
it); (ii) use your software package and the 4th order Runge-Kutta method 
with the given initial conditions at xo to estimate the numerical solution at 
the value x = x9 + 5.0 for the step sizes h = 0.5,0.01 (this will require two 
different runs of the software code). 

. Ty” +4y' — 3y =0, y(0) =0,y'(0) =1 

y" +2°y' + 12y =0, y(0) =0,y'(0) =7 

y” +2y'+10y =sinaz, y(r) =e',y'(x) =1 

y" ty! + 2ay = 2x, y(—1) = 1y'(-1) = 

(@ + 2)y" + 3y =a, y(0) =0,y/(0) =4 

y” +4y’ + 3sin(y) = 1, y(0) = —-1,y/(0) =a 

. (2? + 2)y” + 3y? = e7, y(0) =1,y'(0) =2 

oy! + ao +y = 82, y(1) =1,y'(1) = 3 

By" + y" = 0, y(0) = Ly(0) = 0,y"(0) =2 

10. y+ o ‘ty t+y=e®, yl) =1,y/(1) =3,y"(1) = 
11. 2? y+ wy" y + sin(y) = ey) = 1a) =0, 
12. a +ay"+ay'+y> =Inz, y(1) =0,y'(1) =0 


13. y —edy 0, ft) =1.¥0) = 19") = 0 
1,y'0) 


CHAAR ONE 


2 
14. 2y!”" — (y" P+y +ay=e, y(0) =1,y'(0) =0,y"(0) =0 
15. (x+2)y +3y!—2y = 0, y(-1) = 3, y'(-1) = -1, y"(-1) = 0,y""(-1) =1 
16. y) — 9y = 0,y(1) = 2,90) = 0,70) =0,9") =1,9"() =1 


3.5 Essential Topics from Complex Variables 


This section gives us a quick overview of some algebra and calculus that 
we can do with complex numbers. Understanding the material through the 
discussion of Euler’s formula (3.34) will be useful for Sections 3.6, 3.7, and 4.7 
while the remaining material of this section will be needed only for Section 
4.4. 
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In one variable, we can only have real numbers for solutions of a linear 
algebraic equation. Things change when we consider a quadratic or higher- 
order equation. In applying the quadratic formula to solve azz? +a,;2+a9 = 0 
where we assume dg, @ 1,42 are real numbers, we can have the new situation 
where we may be required to take the square root of a negative number; that 
is, we consider 


2 
—a, + / az — 4a2a0 
L= 1 , for az < 4azao. 
2a2 


We define a new number 
i=V-1 

so that our answer is made up of a part with 7 and (potentially) a part without 
i. We note that i? = —1. These are called complex roots of the equation 
and are denoted a+ib, where a,b are both real numbers. Our first important 
point to realize is that complex numbers come in conjugate pairs—we can’t 
ever just have a+ ib without also having a — ib. Another key point is that 
we can’t combine real numbers together to get a complex number without 
introducing the imaginary number 7 into the problem. We typically write 
a complex variable as z and observe that, in general, it is made up of a real 
part a and an imaginary part b. We use the following to denote this: 


Re(z) =a, Im(z) = b. 


We point out that the imaginary part of z is not 7b but is instead just the 
coefficient b. 

We can add, subtract, multiply, and divide complex numbers as well as 
multiply by constants (either real or complex). Let z = a+ ib, 21 = a1 + iby, 
and z2 = ag + ibe with a,b, a1, 61, a2, b2,c real numbers. Then we have the 
following: 


Addition and subtraction of complex numbers: 


4+ z= (ay ib) t (a2 ib2) => (ay + az) sa i(by + bz) 


241-22 > (ay ar ib) = (a2 =r ib2) => (ay = a2) iia i(by = bz) 


Multiplication of complex numbers: 


2122 > (ay + ib;)(a2 + ib2) = a1a92 t (arb t by a2) t i7b1b5 


= (ay a2 byb2) t i(aybe bi a2) 


Multiplication of a complex number by a real constant: cz = ca+icb 


In order to show division, we first note that we don’t ever leave complex 
numbers in a denominator. In other words, we always simplify a fraction to 
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the form a+ ib where a,b are real numbers. In order to do this, we need the 
idea of a complex conjugate, denoted with a line (or bar) over the complex 
number. This means we change the sign of the imaginary part: 


Z=at+ib=a-—ib. 
We also observe that 
2% = (a+ ib)(a — ib) = a? + 0. 
Thus if we don’t want a complex number in the denominator, we will need to 
multiply by its complex conjugate. Thus we can show: 
Division of complex numbers: 


Zl ay + iby _ ay +r iby ag — ib = (a1 a2 + bbz) + i(—aybe + bi a2) 


22 a2 + iby a2 —-- iby az — ibe as + be 
—S_ 
22 
=1=—= 
22 


_ (“5 + | ee 

“\"@oe J '\ @+R )? 
where we highlight that the final answer is in the form a+ 7b for real numbers 
a, b. 

Because we can’t get a complex number from real numbers alone, this fun- 
damentally means that we need an extra dimension in order to view complex 
numbers. To do this, we consider the horizontal axis as the real axis and the 
vertical axis as the imaginary axis and refer to this as the complex plane; 
see Figure 3.1 


RA 


FIGURE 3.1: Cartesian and polar representations of a complex number z. 


Any complex number z = a+ib can be represented as a point in the complex 
plane. Now is where things get interesting because we will additionally view 
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this point in the complex plane with its polar coordinates that correspond 
to the point (a,b). In doing so, we know that its length is r = Va? + b? 
while it makes an angle @ = arctan (2) with the real axis. We can also write 
a =rcos@ and b= rsin@ using polar coordinates. A useful and interesting 
fact from the theory of complex variables is Euler’s formula: 


e’” = cos + isin (3.34) 


which is valid for all 6. This expression can be obtained in many ways and we 
refer the interested reader to the exercises for two such excursions. We give 
one remarkable application of Euler’s formula; namely, letting 0 = 7 we have 
e’"" = cosa + isint. 
That is, e** = —1 or 
e74+1=0. 


This astounding expression relates the five most famous (and useful) constants 
0,1,e,7, and 7. Now, let’s get back on track. 

With this formula in hand, we can observe that any point in the complex 
plane can also be written as re’” since 


° ~rcosO+irsind =a+tib. 


re’ 
Because any point in the plane can be written as a complex number, this 


means that any number can be written in the form re’’. 


Write the following numbers in the form re’: 1, —i, 1 —i, and 


1+ 32. 


Solution 
i) 1 is on the real axis so we know 0 = 0 or 0 = 27. Thus, two possibilities 


are 1 = 9"? or T=", 
ii) —i is on the imaginary axis so that 6 = 3%. Thus, one choice is i = e3"/?, 
iii) 1 — 7 is on the —45 degree line; that is, it makes the angle =* with the 


real axis. It is easy to calculate r = \/1? + (—1)? = V2. Thus we can write 
1-i= V2eir/4. 

iv) For 1 + 32, we can calculate the angle it makes with the real axis as 
@ = arctan(3) and the length as r = V12+3? = V/10. Thus 1+ 3i = 
/10e! arctan(3) 


In the above example, we always had multiple possibilities to choose from 
for the angle 6. The notation that is often used is arg(a + iy). Thus, for 
example, 


; nt On Tx 157 
arg(1 i= 4? A ge 4 ia 
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where we have simply added +2n7,n = 0,1,--- to the first answer to obtain 
the others. We sometimes will specify that we want the principle value, 
where we specify that —7 < 6 < m7 and we write Arg(x + iy) to denote this. 


ee Arg(1—i) = —" 


Writing complex numbers in this form also allows us to find roots of any 
complex number. 


| Example 2 | (i) Find all z satisfying 2° = 1. 


ii) Find all z satisfying 24 = —1. 
(ii) ying 


Solution 

(i) We again rewrite 1 as e’*7 and note that roots must be equally spaced apart. 
Taking the cube root of both sides gives z = e’2/3. Since roots must be equally 
spaced and we are looking for 3 of them, the roots must be separated by 27/3. 
The other two roots are then 


127 


aveneren(s), cil2n/3+47/3) | 


Thus our roots, written in the form a + ib, are 


ai. Wa: 2 a ee 
i2n/3 _ sve i4n/3 VE i6r/3 __ 1 
e 5 +1 a? e€ 5} a ; 
(ii) Since we are looking for 4 roots, they must be spaced apart by 27 = 
The first of these roots is obtained by taking the fourth root of Te = 
which gives e’"/4. The other three roots are thus e@("/4+7/2), ell /442n/2)_ 
and e(*/4+37/2) Written in the form a+ ib, we have 


awa 


: 1 1 . —1 1 
in/4 = ° i3n/4 —_ : 
€ = Se ty = — +1, 
2 2 v2 V2 
a a a 
AA 2 a 
| Example 3] Let p(z) = 2? + 3x — 2 be a polynomial. Calculate p(i) and 
p(—1 + 32). 
Solution 


We treat p(z) in the natural way that we would think of doing: 

(i) p(i) = oe 7a 1+3i-—2=>—3 +33. 

(ii) p(—1+37) = (-1+3%)?+3(-1+3%) -2 = (1-9+7(-6)) +(-—3+9i) -2 = 
—13 + 32. . 


Sometimes it will be easier to deal with complex numbers and functions 
rather than real-valued ones. One of the key facts that make this helpful goes 
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back to our ability to separate out real and imaginary parts. Specifically, we 
can take a real-valued function, write it as a complex-valued function, ma- 
nipulate it according to our known rules, and then take the real part. Our 
answer in the end will be the same as if we hadn’t made it complex! We first 
take a look at an example where we complezify our real-valued function. 


|Example 4| (i) Write sin 2% as the imaginary part of a complex function. 


(ii) Write e~°* cosz as the real part of a complex function. 
(iii) Show that Asinwt + Bcoswt = VA?+ B*cos(wt — ¢), where ¢ = 
arctan (4) and A, B,w,t are real-valued constants. 


Solution 
(i) From Euler’s formula, we know that e’” = cosx + isina, from which it 
follows that e’?* = cos2x +isin2z. Thus 


sin 27 = Im(e’?"). 


—3a+ian 


ii) We multiply Euler’s formula by e~?* to obtain e =e cosr + 
y 


ie~°” sin x. Thus 


=3 


e~ >” cosz = Re(e*-3+9), 


(iii) Using similar ideas as in (i) and (ii), we write 
Asinwt + Bcoswt = A-Im(e™*) + B- Re(e*”*) = ARe(—ie*) + BRe(e*) 
— Re((B — Ai)e™*) _ Re( / A2 +4 B2e7? arctan eee) 
a ea 


B-— Ai in polar form 


— Re (VAP + Beet we erctan(a/3)) 
= Re (v A? + Bika) , @=arctan (5) . (3.35) 


The way we would hope to be able to take derivatives and integrals still 
holds: we just perform the operations on real and imaginary parts separately, 
treating 7 as a constant. 


|Example 5 | (i) Evaluate qa (08 2x + isin 22). 
x 


i. 
(ii) Evaluate —(e’”). 
dx 


elution 
(i) a 2x +isin 2x) = —2sin 2x + 12 cos 2a. 
x 
(ii) an )=e ag (it) = te : - 
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Combining these last few comments will finish our discussion of complex 
numbers. 


Example 6 RXWanete a sin 2x) in two ways: 
x 


(i) Take its derivative as written (don’t convert to complex functions). 
(ii) First write the function as the imaginary part of a complex function, take 
the derivative of the complex function, then separate out the imaginary part. 


Solution 
(i) This is a straight product and chain rule application: 


—x@ 


=2e *cos2a —e “sin 2x. 


d 
a er sin 2x 4 sin 2a € 


(ii) We first write this as e~* sin2z = Im(e~*t?"). Taking this derivative 
gives 


(e~” sin 2a) = e~ 


ae = (-1+4+ 2i)e"* +" — (—1 + 21)(e* cos 2x + ie* sin 22) 
x 


(—e~* cos 2a — 2e~* sin 2x) + i(—e~* sin 2a + 2e~* cos 22). 


Our final answer is the imaginary part of this: 


d d 
—(e sin 2x) = Im (fe) =-e *sin2x + 2e "cos 2x. 
xv 


dx 
im 
| Example 7 | Evaluate | e3+24)* dz Write the final answer in two equivalent 


forms: 

(a) zw(a) for complex-valued constant z and complex-valued function w(x) 
and 

(b) f(x) + %g(x) for real-valued functions f, g. 


Solution 
We treat 7 as the se eugs 
2)x T4)e 3 2% 3— 2% ; 
(3+2i)¢ q> — fe © . eg (3+2é)2 4 
ca he o— 340 °° 3508 3-23 13 ° 


(b) From the last line of (a), we then have 


peas _3 FH eotane C= (3 — 2i)e3* (cos 2x + isin 2x) LC 


13 
_ &*(3cos2e + 2sin2x) | 8 sin 2x —2cos2z) | C 
7 13 : 13 — 


We note that C may be a complex-valued constant. 
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We will finish our discussion of complex numbers with an algebraic example 
in which our constants may be complex. 


| Example 8 | =. Solve the system of equations 


(2+i)A, =3 (3.36) 
A, +3Ao9i=0, <Aj,Ao €C. (3.37) 
Solution 
From (3.36), we have 
3 3 2-i 3(2-%) 6 38 


Ay 


jig O49 Soy Ae oe 


Substituting A, into (3.37) and solving for Ag gives 


6 3 - 9 18 
A= Ay _ BEE (SE) = Sib =F tis 


3i 3% —3i/ 9 a aie 
ia 

So e e e e e e e e e e e 
Problems 
In Problems 1-10, write the following numbers in the form re’’. 
1. 4i 2. ivV/2 3.-1+i 4.14/31 
5.-14 /3i 6.3— V3i 7.44 34 8.345% 
9.2-i 10. —2+ 32 


In Problems 11-16, find all z satisfying the given equation. 
11.z27-1=0 12. 27+4=0 13. z2-i=0 14. 234+%1=0 
15.2°+16=0 16.24+64=0 


In Problems 17-22, evaluate the polynomial at the given complex number. 


17. p(x) = 227 —x +1; 1+, 2i 18. p(x) = 27 +241, 1-4, 3% 
19. p(z) = aa, 1 +1 20. p(z) = =: -4., i 
21. p(z) = ay; 2i, 1-1 22. p(z) = S53 2i, 1-1 


In Problems 23-30, write the given function as the real part or imaginary 
part of a complex-valued function. 


23. cos x 24. sin 3x 25. e” sin 2x 
26. e~?" sina 27. cosxz — sine 28. 3cos 2x + sin 2x 
29. 2e-* cos3x +e” sin3x 30. e~* cos 2z+3e~” sin 2x 


In Problems 31-38, evaluate the following expressions. Write in the form 
f(x) +ig(a) for real-valued functions f, g. 
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31. 4 (isin(2z)) 32. H(c%'”) 33. #4 (e" sin(x)) 
34. 4 (e?"* cos(3x) + sin x) 35. [ e-*dz 
36. felt ge 37. feta 38. [ ie?*dx 


In Problems 39-42, solve the system of equations for the possibly complex- 
valued unknowns. 

39.iA, =1, A, +iAo =0 40. iAg = 1, 2A, +iAo = 0 

41. Aj = iAg => 1, 2A, + iAg = 42. iAy + As = 1, Ay + 21 Ao =, 


43. Show that e is a solution to 7” +a =0. 


AA, Show that e’” is a solution to x” + 4x7 = 0. 


45. Use separation of variables to show that e(¢+*)! is a solution to 2’! = 
(a+ ib)a. 
46. Show that, for real-valued constants A and B, 


B 
Asinwt + Bcoswt = VA? + B?sin(wt+¢), = arctan (3) : 


(Hint: Follow Example 4(iii) except using Im instead of Re.) 


47. Use Taylor series for e”, cosx, and sinx to show Euler’s formula. (Hint: 
Expand e’”.) 


48. As another method of obtaining Euler’s formula, consider 
a= e’” and zg = cos6+isiné. 


Show that these two expressions are both solutions of the complex-valued 
initial-value problem 


dz 


a iz with z(0) =1 


and give reasons why you can conclude that they must be identical. 


3.6 Homogeneous Equations with Constant Coefficients 


Now we will consider how to actually find linearly independent solutions 
for 


d’y d’—ly dy 
a + An— +... +a +aoy = 0, 3.38 
n dx” n—1 dxzn—1 1 dx oY ( ) 
a homogeneous linear equation with constant coefficients @,,@n—1,-.-,d0 € R. 


In the case of a second-order, constant-coefficient equation, we “guessed” a 
solution of the form e”™ (in Section 3.1) based on what happened in the case 
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of the linear first-order homogeneous equation. For the nth-order equation, 
we are looking for a function with the property 


£ fle) = cf (a) for all a. 


This is a property of the exponential function: 


Thus we substitute y = e”” into (3.38) and evaluate the derivatives to obtain 
ayre’® + a,_y7r” te +... + ayre™ + ape™ =0, 
which can be rewritten as 
ee (anr” + Qn_1r b+... tart ag) = 0. 


We again observe that e™” # 0 so that our solutions are obtained from solving 
a polynomial in r: 


Ont” +an_ir™ 1+... +air+ag = 0. 
eee 
= P(r) 


This polynomial, which we denote P(r), is known as the characteristic 
equation and its roots are known as eigenvalues or characteristic values. 
(Sometimes the equation is also referred to as the auxiliary equation.) Cor- 
responding to each eigenvalue is the eigenvector y = e’”, which is a solution 
to (3.38). 

For the equivalent formulation in operator notation, we observe that D*e’® = 
r®e® so that 

P(D)e™ = P(rje™, 


where P(D)y = 0 is our differential equation and P(r) = 0 is the resulting 
characteristic equation. 

Now, recalling the Fundamental Theorem of Algebra, we know an nth 
degree polynomial has n roots if we allow for the possibility of complex roots 
(and we count repeated roots, too). There are three cases to consider based 
on these n roots. We may have roots that are real and distinct, roots that are 
repeated, or roots that are complex. In general, we may have a combination 
of all three. We will consider each of these cases. 


Case 1: Distinct Real Roots 
We begin with a theorem that characterizes this case. 
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THEOREM 3.6.1 

For the nth order homogeneous linear differential equation (3.38) with 
constant coefficients, if the characteristic equation has n distinct real 
roots 71,1T2,---,Tn, then e™”, e"27,--- ,e™” are linearly independent so- 


lutions of (3.38). The general solution is given by 
y = ce"** + cge”?” +...+ ene" 


where C1, C2,...,Cn are arbitrary constants. 


It should be clear that e™!”, e7?”,--- ,e’™” are solutions; see Figure 3.2. We 
can see they are linearly independent by calculating W(0), that is, the Wron- 
skian evaluated at « = 0. Since they are solutions, recall that W(x) is either 
always 0 or never 0. 


For instance, in the case of a third-order equation, we would have 


erie e"2” er3® 1 1 1 
W(0) = rye"! 2 rge"2” rge"? = Ty T2 3], 
cer reer” ie Me r? r2 re 


which can then be expanded and simplified as 
W(0)=1- (rare - rar3) — (rire — rir) +1- (rir3 - rir) 


1- 
ror3 +717r2) — ri(ra —ryr3 +7172) 


= ro(r3 — 

= ro(r3 — rears + rire) —ri(r? —rir3 t+ rire) — rerirs + rirars 
= ro(r3 — ror3 +11%2 — 17173) ri(rz ryr3 +111r2 — Tars) 
=ro(rs—ti)(rs — ro) — 71a — 71) (ra — 7a) 


= (re ri)(r3 ri)(r3 r2) 


40 (3.39) 


where the last line is true since the roots are distinct. 
In general, we have for an nth-order equation that 


I]t: —r;)(-1)"™, 


where the symbol II (capital Pi) denotes the product of all the factors that 
follow. 


| Example 1 | Consider the differential equation 
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y y 


(a) (b) 


FIGURE 3.2: Basic shapes of solution curves for real, distinct roots: (a) 
e’” for r > 0; (b) e” for r <0. 


The characteristic equation is 
r?—r—6=0 
which has the roots 
r=—-2 and r=3. 


Thus, e~?” and e®* are linearly independent solutions and the general solution 
is thus 


—22 3x 
= cye + ce. 
y 1 2 = 
| Example 2 | Consider the differential equation 
d’y  d’y | dy 
4 6y = 0. 
dx? dx? " dx ee 


The characteristic equation is 
re —4r?+r+6=0 


for which we have some difficulty solving for r. In most cases, the character- 
istic equation will not factor nicely and numerical methods will perhaps be 
needed. It is also useful to employ a computer algebra system or recall some 
college algebra techniques. 

In the present case we get lucky, of course, because r = —1 is a root. This 
means that r+ 1 is a factor. The other factors can be found by division to be 
r—2andr—3. That is 


r — 4r? +r +6 = (r +1)(r —2)(r — 3). 


x 


Hence, e~”, e?”, e?” are solutions. Thus 
? ? 2 


= 2 
y = ce” + cge*” + cge*” 


is the general solution. 
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Case 2: Repeated Real Roots 
Many times we will have a root that is repeated and this requires a modifica- 
tion of the solution from Case 1. 


| Example 3 | Consider the differential equation 


d’y dy 


The characteristic equation is 
r? —6r+9=0=> (r—3)? =0. 


The roots are 
ry=3 and re =3 (double root!). 


3a 3a 


corresponding to r; = 3, and the solution e 
3 is not linearly independent of e?”. So 


So we have the solution e 
corresponding to rg = 3. Clearly, e 
we have a small problem. 

Since we already know one solution is e 
equation (see Section 3.3). Let 


3” we can reduce the order of the 


y= erty 
Thus d d 
7 = a 3e37u 
and ; 
os - ead 4 gore + 9e3*y 
dx? dx? dx 
Substituting into the original differential equation and simplifying gives 
32 av 
dx2 
Letting w = qe we have 
dw 
3a 
— =0. 
°c 


This gives that dw/da = 0 and thus w = c. We can let c = 1 so 
v=2+C9 


and thus 
u(x)e?* = (x + co)e** 


is a solution to the second-order equation. Now we know that (x + co)e>” 
and e?” are linearly independent (check the Wronskian!), so taking co = 0, we 
have corresponding to the double root 3, two linearly independent solutions 


32 


e€ and xe®”. 
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Thus, the general solution is 


y = c,e** + coxe®*. 


Generalizing this example, if a second-order homogeneous linear equation 
with constant coefficients has r as a double root to its characteristic equation, 
then e™” and awe’ are the corresponding linearly independent equations; see 
Figure 3.3. Extending this idea further, we have the following theorem. 


THEOREM 3.6.2 
Consider the nth order homogeneous linear differential equation (3.38) 
with constant coefficients. 
1. If the characteristic equation has the real root r occurring k times, 
then the part of the general solution corresponding to this k-fold repeated 
root is 

(cy + egu + Ce ee Cr = Ne. 


2. If, further, the remaining roots of the characteristic equation are the 
distinct real numbers rp41,7k+2,---,7n, then the general solution is 


y=(cr teu + @an” te oo. tt Gre Ne + cppie™*tt® +... +¢ne"™”. 


3. If, however, any of the remaining roots are also repeated, then the 
parts of the general solution to (3.38) corresponding to each of these 
other repeated roots are expressions similar to that corresponding to r 
in part 1. 


(a) (b) 


FIGURE 3.3: Basic shapes of solution curves for real, repeated roots: (a) 
xe™ for r > 0; (b) we’ for r < 0. The figures here are to be combined with 
the corresponding part of Figure 3.2. For example, a second-order equation 
with r < 0 as a repeated root will be a linear combination of Figures 3.2(b) 
and 3.3(b). 
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Dre Colo the equation 


dy 4 dy 
dx? dx? dx 


Solution 
The characteristic equation is 


r? — 4r? — 3r +18 =0 


which has roots 3, 3, —2, (check it!). Theorems 3.6.1 and 3.6.2 tell us that three 
linearly independent solutions are e*”, xe®”, and e~?*. The general solution 
is thus 

y = cye** + coxe®® + c3e~ 2". 
iz] 


| Example 5 Suppose a sixth order homogeneous linear differential equation 


with constant coefficients had the following roots of the characteristic equa- 
tion: 


A; 21.0.9 3,3 


Then six linearly independent solutions are e~*, re~”, e?”, €®”, re?” , x? e3” and 
the general solution to the differential equation is 


= cje* + cone * + cge** + cae?” + cxxe** + cgxe**. 
6 


Case 3: Complex Roots (Non-Real) 
Now suppose that the characteristic equation has a + bi, a complex number, 
as a root. (Here, a and b are real numbers, b 4 0 and i? = —1.) 

Because complex roots of a polynomial with real coefficients always come 
in conjugate pairs, we know that a — bi is also a root. In obtaining the 
characteristic equation, we observed that e™ solves the differential equation 
but did not require that r be real. Thus, e¢+?)* and e(¢—*»)” are linearly 
independent solutions and the corresponding part of the general solution is 


kyeltth? 4 ky ela—bi)e (3.40) 


where ky, and kg are arbitrary (real) constants. 

Note that the solutions defined by e(¢+%)* and e(¢—-*)” are complex func- 
tions of the real variable x. We are interested in real linearly independent 
solutions. 
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If we apply Euler’s formula to Equation (3.40), we have 

kelathe 4. fpyela-bie — paw (kre? + koe”) 

= e* (ki (cos ba + isin bx) + kg(cos ba — isin bx)) 
=e ((ky + kz) cos ba + i(k, — ke) sin bx) 
=e" ( 


“” (ce, sin bx + c2 cos bx) , 


where cy = ky + kg and cp = i(k, — kg). Thus, corresponding to the roots 
a bi is the solution 


e*” (c, sin bx + c2 cos bx) , 


where e“* sin bx and e“* cos ba are two, linearly independent, real-valued so- 
lutions; see Figure 3.4. We have the following theorem. 


THEOREM 3.6.3 
Consider the nth order homogeneous linear differential equation (3.38) 
with constant coefficients. 
1. If the characteristic equation has conjugate complex roots a + bi 
and a — bi, neither repeated, then e“” sinba and e“” cos bx are linearly 
independent solutions. The corresponding part of the general solution 
may be written as 

e*” (c, sin bx + c2 cos bx) . 


2. If, however, a + bi and a — bi are each roots of multiplicity k of 
the characteristic equation, then the corresponding part of the general 
solution may be written 

eo (c1 Soe tei 22 ae Crs) sin bx 


+e (ck PiaE Celot Cpe ge) ee Copn**) cosba. (3.41) 


d 
Example 6 R\tanat equation 7 + 9y = 0. 
x 


Solution 
The characteristic equation is 


r?+9=0 


which has solution r = +32, so that a = 0 and b= 3. Then sin 32 and cos 3x 
are two linearly independent solutions and the general solution is 


y =c, sin 3x + c2 cos 3a. 
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(a) mM (b) 


FIGURE 3.4: Basic shapes of solution curves for complex roots: (a) linear 
combination of {e** cos(bx), e*” sin(bx)} for a > 0; (b) linear combination of 
{e*” cos(ba), e*” sin(ba)} for a < 0. Notice the envelope +e** that bounds 
the solution in both parts. 


| Example 7 | Solve the equation 


(D? — 6D + 25)(y) =0. 


Solution 
Try not to be confused by the use of the operator notation—it is actually 
easier to write the characteristic equation. The characteristic equation is 


r? —6r+25=0 


which has roots r = 3+ 4i. Two linearly independent solutions are e** sin 4x 
and e?* cos 4x and thus 
y = e°*(c, sin 4x + cp cos 42) 
is the general solution. 
al 
| Example 8 | =) Solve the equation 
dty ,@y |, @y 


dy 
sat 7 Aggs t Maga — 20g, + By = 0. 


Solution 
The characteristic equation is 


r4 — 4r? + 14r? — 20r + 25 = 0. 


This is nontrivial to solve by hand; however, in our respective computer pro- 
grams we could easily find the roots as 


;, 142%, and 1—2%. 
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These are double complex roots, and linearly independent solutions are 
e” sin 2x, xe” sin 2x, e” cos 2x, and xe” cos 2x. The general solution is thus 


y =e" [(cy + c2x) sin 2x + (c3 + C42) cos 22} . 
il 


We have yet to consider any initial-value problems, but these are very 
straightforward as can be seen in this next example. 


| Example 9 | Solve the initial-value problem 


dy dy 

“4 _ 69% 4 95y = 

dx? Ore a 
with the conditions y(0) = —3 and y/(0) = —1. Plot the solution on the 
interval -l1 <a <1. 
Solution 


In Example 7 above, we obtained the general solution as 
y = e**(c, sin 4x + cy cos 4z). 
We observe that y(0) = —3 implies that cg = —3 and y’(0) = —1 gives 
4c, + 3cg = —-1 
so that c; = 2. Thus the solution is 


y = e"(2sin 4x — 3cos4z). 
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FIGURE 3.5: Plot of solution for Example 9. = 


Second-Order Linear Homogeneous Equations with Constant Coef- 
ficients 


The theory we have developed in our method of solving nth-order linear ho- 
mogeneous equations with constant coefficients relies upon finding the roots 
of the corresponding nth degree characteristic polynomial. Since polynomials 
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of degree two can be explicitly solved, all solutions of the second-order linear 
homogeneous equation with constant coefficients 
dy dy 
a2 —> +a, — + any =0 3.42 
* da? Pe OH ee) 
are obtained from the roots of the quadratic equation 
agr? + air + ao = 0. 


These roots are easily obtained by the quadratic formula as 


= 2= Jaz = 4aza0 (3.43) 


re 2a 
so that the general solution to (3.42) is 
cye"!* + cne"?” if at > 4azao 
y(x) = & (cy + egx)e7 19/2 if a? = 4azao (3.44) 


e 17/242 fo, cos(wa) + cp sin(wa)| if a? < dazao, 
; 1 at 
where c, and c2 are arbitrary constants and w = —\/a2d9 — re 
a2 

| Example 10| ‘\)) Solve the equation 

d’y | ody 

—— +8— + 15y = 0. 

dx? dx : 


Solution 
Since the characteristic equation is r? + 8r + 15 = 0, we see that it has two 
real roots, which are 

ry = —3 and rg = —5. 


Thus the general solution is 


y(z) = ce 3” + pe”. 
ii 
| Example 11 Solve the equation 
Gy | dy 
A iyi 
dx? 7 d. ¥ 


Solution 
Since the characteristic equation is r? + 2r + 2 = 0, we see that it has two 
complex roots. Applying Equation (3.44) gives 


1 at 
—4/ —~t=1. 
ao ne 4 
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Thus the general solution is 


y(x) = e” [c1 cosa + co sina]. 


a 
| Example 12) Solve the equation 
dy dy 
Solution 
Since the characteristic equation is r? + 6r +9 = 0, we see that it has a 
repeated root of r = —3. The solution is thus 
—32 

y(t) = (cr +22) (e*). ” 
e e e e e e e e e e e e 
Problems 
In Problems 1—22, find a general solution of each equation. 
1. y” + 8y' + 12y =0 2. y”" — 36y =0 
3. y” — 3y’ +4y =0 4, 2y" — Ty’ + 3y =0 
5. y —2y' =0 6. 8y'" + y” =0 
7. 4y"” + 4y'’+y=0 8. 2y” — 3y’ + 4y =0 
9 y” —4y' +5y =0 10. y\ —y=0 
11. (D* — 16)(y) =0 12. (D? + 1)?(y) =0 
13. (D? + 4)?(y) =0 14. y!"” + 3y” — 4y' — 12y =0 
15. y/” — 3y” + 3y’ —y=0 16. (D — 4)?(D? — D— 2)\(y) =0 
17. y(t — 5y” + 4y =0 18. y) + 8y!” + 16y’ = 0 
19. y) — 10y’” + 9y’ = 0 20. D3(D? —-6D + 9)(y) =0 
21. D?(D — 1)?(D? + 1)(y) =0 22. D(D? + 4)(D? — 2D + 1)(y) =0 


For Problems 23-30, find the solution to each of the IVP. 
23. y"” +y' — 12y =0, y(0) = 0, y/(0) =7 

24. 9y” + 6y’ + 4y = 0, y(0) = 3, y/(0) =4 

25. y” + 4y’ + 4y =0, y(0) =0, y/(0) = 1 

26. 4y” — 4y’ — 3y = 0, y(0) = 1, y/(0) = 
27. (D? +2D + 10)(y) =0, y(—7) =0, y 
28. 2y” + 5y’ + 2y =0, y(0) =7, y/(0) = 
29. (D? + 4)(y) =0, y(m) =1, y(n) =1 
30. y!” + 2y” — 5y’ — 6y = 0, y(0) = 0, y’ 


5 
(—-n) =1 
1 


(0) =0, y"(0) =1 


For Problems 31-34, find a differential equation for which the characteristic 
equation has roots r; with corresponding multiplicities k;. 

31. m= —2, ky I; i) 0, ko 2 

32. Ty 31, ky 2: 12,3 1+ a, ko =i 

33. TL = 0, ky =A; 72,3 =2+4+ 31, ko =3 

34.7) = 243i, ky = 2; r3 = —5,k3 = 1; 74 = 2, kg = 38 
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35. Show that a general solution of the differential equation 
ay” + 2by’ + cy = 0, b? —ac>0 


can be written as 


eo. Rosa: Gin 
ya eta . ot (=) hat (=) | 


a a 


3.7 Mechanical and Electrical Vibrations 


We will now consider the motion of a mass attached to a spring by taking 
into account the resistance of the medium and the possible external forces act- 
ing on the mass. We note that although we have used y(x) as our variable for 
much of the book, we switch to x(t) for this section in order to stay consistent 
with the notation used in much of engineering and physics; see Figure 3.6. 
We need a fact from physics to begin our in-depth examination. 


Hooke’s law: It is experimentally observed that the magnitude of the force 
needed to produce a certain elongation of a spring is directly proportional to 
the amount of the elongation, provided the elongation is not too great. That 
is, 

|F| = ks (3.45) 
where |F'| is the magnitude of the force F’, s is the amount of elongation, and 
k is a constant of proportionality, called the spring constant, which depends 
upon the characteristics of the spring. 


k 


lx 


FIGURE 3.6: Mass on a spring at rest position, = 0. 


|Example 1, If a 30-lb weight stretches a spring 2 ft, then Hooke’s law gives 


30 = 2k 
or 
k = 15 lb/ft. 
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When a mass is hung upon a spring that has a spring constant k and pro- 
duces elongation x, the force F of the mass upon the spring has magnitude 
ka. At the same time, the spring exerts a force upon the mass called the 
restoring force. This restoring force is equal in magnitude, but opposite in 
sign to F and hence is —ka. 


Formulation of the problem: Suppose the spring has natural (unstretched) 
length L. The mass m is attached to the spring and the spring stretches to its 
equilibrium position, stretching the spring an amount @. The stretched length 
is D+ &. 

For convenience, we assume the origin of a coordinate system at this equi- 
librium position. We also assume the positive direction as down. Thus, the 
value x of this coordinate system is positive, zero, or negative, depending 
upon whether the mass is below, at, or above equilibrium, respectively. 


Forces acting upon the mass: In this coordinate system, forces tending 
to pull the mass downward are positive, while those tending to pull it upward 
are negative. The forces are: 

1. F\, the force of gravity. This is given as 


Fi =mq, 


where m is the mass and g is gravity. F\ is positive since it acts downward. 
2. F2, the restoring force of the spring. Since «+ is the total elongation 
of the spring, by Hooke’s law, the magnitude of this force is k(a + @). When 
the mass is below the end of the unstretched spring, the force acts upward 
and is thus negative. Since x + ¢ is positive, we have in this case 


Similarly, if the mass is above the end of the unstretched spring, the spring 
is acting downward and thus this force is positive. However, «+ @ is negative, 
so that in this case we again have 


At the equilibrium point, the force of gravity is equal to the restoring force, 
so that 
—mg = —k(0+ 2) 


or 
mg = ke. 


Hence, we have the equation 
Fy = —kx — mg. 


3. F3, the resisting force of the medium. This force is also known as the 
damping force. The magnitude of this force is not known exactly; however, 
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it is known that for small velocities, it is approximately 


where b > 0 a constant, which is known as the damping constant. Note 
that when the mass is moving downward, F3 acts in the upward direction so 
that F3 < 0. Here, moving downward implies a increases so that dx/dt > 0. 
Thus, when moving downward 


dx 
Fs = —b—. 
: dt 


Similarly, when moving upward «x decreases, so that da/dt < 0. Thus, in 
this case, we again have 


4. Fy, any external forces that act upon the mass. We will let the 
resultant of all such forces at time t be F(t) and write 


Fy = F(t). 
Now we can apply Newton’s second law: 
F=ma 


where 
F=f, + Fo + F3+ F4, 


the sum total of the forces involved. We thus have 


dx dx 
mag = mg ka — mg bs + F(t) 
or P ‘ 
x x 
— —+kxz = Fit). A 
m2 +o +kax (t) (3.46) 


This is the differential equation A for the motion of the mass on a spring. It 
is a nonhomogeneous second-order linear differential equation with constant 
coefficients. 

If b = 0, the motion is called undamped; otherwise, it is called damped. If 
F(t) = 0 for all t, the motion is called free; otherwise, it is called forced. 


Undamped Oscillations 


In the case of free undamped motion, both b = 0 and F'(t) = 0 for all t. This 
gives the differential equation 
as 
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where m > 0 is the mass and k > 0 is the spring constant. Thus, if we divide 
through by m, we have 


Since m,k > 0, we let wp = 4/ - (where w,, is known as the natural 


angular frequency) and substitution yields 


a 


The corresponding characteristic equation is 


which has roots 


The general solution is thus 
a(t) = ¢; sinw,t + cy cos wt. 


Now we suppose that the mass was initially displaced a distance xp from 
the equilibrium with an initial velocity vo. That is, 


2(0) = ap and 2'(0) = wp. 
Using these initial conditions, we find that 


v 
a=— and c2 = Xo 

Wn 

so that . 
a(t) = — sinwat + x9 coswnt. (3.47) 
Wn 

Although Equation (3.47) completely describes the motion of the spring at 
any given time, it is often easier to picture the solution curves if we write the 
solution in an alternate form (amplitude-phase form), as 


x(t) = Acos(w,rt — ), 


where A will be an amplitude and ¢ the phase constant. The quantity 
(w,t — @) is called the phase of the motion. 

To accomplish this we first observe that the maximum amplitude of (3.47) 
is given by 


AZ (2) +28 (3.48) 


Wn 
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Each of the two terms contributes to this A. To see this contribution, we 
consider the fractions 

0: gag MN 

A A 
These quantities are both between 0 and 1 (Why?). They also satisfy the 


relation ; 
Xo \? vo/Wn \~ 
(3) +( A ) = 


v9 /Wn 


A 


which clues us in to set 


na) 


cos @ = Ai 


and sing = 


for some ¢. Rewriting these two expressions and substituting in for zg and 
Up /Wn gives 
x(t) = Acosw,tcosd + Asinw,t sin ¢. 


Recalling the trig identity 


cos(a + b) = cosacosb F sinasinb 


gives us that 
x(t) = Acos(wnt — ¢) 
= (=) + x2 cos(wnt — ¢). (3.49) 
Note that we could have obtained a similar expression 
x(t) = Asin(w,t + ¢) (3.50) 


if we had set 
v9 /Wn 
A 9 
and used the trig identity sin(a + b) = sinacosb + cosasinb. We thus have 
two identities that can be quite useful: 


Acos(wt- 4), A= /A+e, $= tan" (2) 


C2 


sing = + and cos¢ = 


ci Sin(wt)+c2 cos(wt) = 4 or 


Asinwt +9), A= ei +e, o=tan™ (3). 


Back to (3.49), this equation gives the displacement, x, of the mass from 
the equilibrium as a function of time t. The motion described by x(t) is called 
simple harmonic motion. The constant A given by Equation (3.48) is the 
amplitude of the motion and gives the maximum (positive) displacement. The 


208 Chapter 3. Elements of Higher-Order Linear Equations 


motion is periodic, with the mass oscillating between x = —A and x = A. We 


have « = A if and only if 
Lk 
—t—-—@=+t2nr. 
m 


So the maximum displacement occurs if and only if 


i= | Zenn +6) > 0. 


The time interval between maxima is called the period, T. Thus 


20 _ 20 
/ & ig 


Just as the spring constant is inherent to each spring, the quantity 


Wy = /* (3.51) 


is inherent to the mass-spring system, hence the name natural angular fre- 
quency. 


| Example 2 | An 8-lb weight is placed upon the lower end of a coil spring sus- 


pended from the ceiling. The weight comes to rest in its equilibrium position, 
thereby stretching the spring 6 in. The weight is then pulled down 3 in. below 
its equilibrium position and released at ¢ = O with an initial velocity of 1 
ft/sec, directed downward. Neglecting the resistance of the medium and as- 
suming that no external forces are present, determine the amplitude, period, 
and frequency of the resulting motion. 


T= 


Solution 
This is an example of free undamped motion. Since the 8-lb weight stretches 
the spring 6 in. = 1/2 ft, Hooke’s law gives 8 = k(1/2) or 


k = 16 lb/ft. 


Further, mass = weight /gravity so 


m 


= lugs. 
39 Slugs 


Thus, the differential equation describing free undamped motion becomes 


8 dx x 
——_ + 16z = —— 4c = 0. 
30 dP +162=0 => TP + 642 = 0 
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Now since the weight was released downward with an ini 
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tial velocity of 1 


ft/sec, from a position 3 in. or 1/4 ft below equilibrium we have 


x(0) = : and.2 (0): 1. 


The characteristic polynomial is r? + 64 = 0 so that r = 4 


x(t) = c1 sin 8t + ce cos 8t. 


+8i. This gives 


1 1 
Using this with the initial conditions gives cy = 3 and cp = A Hence, 
1 1 
x(t) = a sin 8t + 7008 8t. 
A graph of this displacement is shown in Figure 3.7. 
Spring aa 
displacement 024 
(in feet) 
° t (in sec) 
FIGURE 3.7: Displacement of the spring in Example 2. 
To obtain amplitude-phase form we have 
ae GV.) _% 
8/ '\4} — 8 
as the amplitude. Thus 
5 
x(t) = - cos(8t + ¢), 
ne : _ 2a 
which is of the form A cos(wt+¢). The period, often denoted T, is 3 =e 


and the frequency is 4/7. We can find ¢ by solving 


to _ 2v% 
~ 


A 


vO 


A 


cos @ = and sing = = 


Wn, 


for @. From these equations we find 


o & 0.46 rad. 
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Damped Oscillations 


When we allow for friction in our system, some very useful and important 
concepts arise. In the case of this damped motion, we again consider 

ax dx 

m—, +b—+kx =0, 3.52 

dt? dt ( ) 
now with b 4 0 but still with F(t) = 0. We again have a homogeneous 
constant coefficient equation and thus we can solve it. Calculating the roots 
of the characteristic equation gives 


_ —bt Ve —4mk  -b , @) i 


r= = + im (3.53) 


2m 2m m 


2m 


We will have three different cases depending on the sign of the quantity under 


the square root. The case of critical damping is when se —4/ & = 0, which 


can equivalently be written as 
b/(2m) _ b/(2m) 


/k/m = Wn, 


These roots and quantities motivate us to consider a slightly different form 


of (3.52) where we first divide by m as we did in the undamped case and 
b/(2m) 


=1. 


introduce the damping ratio ¢ = 


, noting that ¢ > 0 and critical 


n 
damping occurs when ¢ = 1. Equation (3.52) is equivalently written as 


Pax dx 

— + 26W, — 27 = 54 

72 + 2¢w qi +wic=0, (3.54) 
with roots of the characteristic equation 

n= (-< de) B= 1) (3.55) 


Recalling the three different cases that arose in our study of constant coeffi- 
cient equations, we see that each case can be realized here depending on the 
value of b? — 4mk or, equivalently, ¢? — 1. 


Case 1: b? > 4mk, ie., C2 > 1 
Then the roots are real and distinct. If we denote the roots r; and ra, the 
general solution can be written as 

a(t) = cye™® + cge"?". (3.56) 


Note that r1 <0 and rz < 0 (check this!). Thus the solution will approach 0 
as t + oo. Depending on the initial condition,” it may cross the rest position 
at most one time but the spring motion will not oscillate as it dies out. This 
case is called overdamped motion; see Figure 3.8. 


?This condition is given by |vo| > |zor2|, where vo (the initial velocity of the mass) and xo 
(the initial displacement) have opposite sign, and rg = wn(—¢ — \/¢?2 — 1) is the smaller 
root of the characteristic equation; see Problem 22. 
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-0.5 


(a) (b) 

FIGURE 3.8: Overdamped motion: 2” + (5/2)a’+a = 0. The initial 
conditions are again «(0) = 1, 2’(0) = 0 in (a) and x(0) = —1, 2’(0) =4 in 
(b). Note that we have overshoot in (b) as the initial condition was chosen 
such that the mass passes through its rest position exactly one time. 


Case 2: b? = 4mk, ie., C2 =1 
Then the roots are real and equal. If we denote the root r, the general solution 
can be written as 

a(t) = ce™ + cote™. (3.57) 


Note that r < 0 and the solution again approaches 0 as t > oo. This last 
statement is obvious for the first term cje™. The reader can check (for in- 
stance, using L’Hospital’s rule) that the second term also approaches zero. 
Depending on the initial condition, the mass may cross the rest position at 
most one time before dying out without oscillation.? This case is called criti- 
cally damped motion; see Figure 3.9. It also represents the motion that will 
die off to zero fastest. 


05 


(a) (b) 

FIGURE 3.9: Critically damped motion: 2” + 27’ + a2 = 0. The initial 

conditions are 7(0) = 1, 2/(0) = 0 in (a) and are x(0) = —1, 2/(0) = 4 in 

ae Note that we again have overshoot in (b). We also note that the motion 
ies off faster than in the overdamped case, even though both systems show 

no oscillations. 


’This condition is given by |vo| > |bxo/(2m)|, where vo (the initial velocity of the mass) 
and xo (the initial displacement) have opposite sign; see Problem 22. 
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Case 3: b? < 4mk, ie., C2 <1 

Then the roots are complex conjugates. If we denote the roots as —Cw,y, + iwa 
(that is, we set wa = Wn./1 — ¢? and note that 0 < ¢ < 1 and wa € R, where 
wq is the damped angular frequency of the system), then the general 
solution can be written as 


a(t) = cye S“"® sin wat + coe $”"* cos wat. (3.58) 


We again state that Cw, > 0 (and thus —Cw, < 0) and the solution again 
approaches 0 as t > co. In this case, the spring will oscillate as its amplitude 
dies off to zero. This case is called underdamped motion; see Figure 3.10. 


FIGURE 3.10: Underdamped motion: 2” + (1/2)a’ + x = 0. The initial 
conditions are (0) = 1, a/(0) = 0. The envelope +e~*/4 is also drawn to 
show the decaying function that bounds the oscillations. 


We can use the earlier trigonometric tricks to rewrite this general solution 


as* 


z(t) = Ae~S“n* cos(wat — $), (3.59) 


A=,/2+4é, cos =F, sing = 5. (3.60) 


The angular frequency of oscillation is now given by 


Wq = WnV1— CP (3.61) 


and the amplitude of the oscillations is bounded by the exponentially decreas- 
ing functions +Ae~‘“"*, which form an envelope that governs this decay. 


where 


4We again note that if we set A = \/c] +3, cosd = 4, sing = 2 we would obtain 
a(t) = Ae~S“n* sin(wat + o). 
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| Example 3 | The differential equation of motion of a damped spring is given 


by 
3a""(t) + 5a’ (t) + x(t) = 0. 


Classify its motion as overdamped, critically damped, or underdamped. 
Solution 

To classify the motion, we simply need to know whether the roots of the 
characteristic equation are real and distinct, real and repeated, or complex. 
In other words, we need to know the sign of b? — 4mk. In this example, we 
have 


b? —4mk = 5? —4-3-1=13. 


Thus the motion is overdamped. We could have rewritten the equation as in 


(3.54): 
a" +2 (2) (=) x'(t) + s(t) =f 


2 
and obtained the same results: ¢? — 1 = (34) —1>0. = 


We stress that the case in which we end up always depends on the relation- 
ship between the mass, the spring constant, and the damping coefficient. In 
the case of no damping, we always end up in case 3. We also note that in each 
of the three cases, the motion of the spring dies out as t > oo. This motion 
is called the transient motion. We have not yet considered how to solve this 
problem when F'(t) 4 0, and will learn how to solve such problems in Section 
4.1. The presence of a forcing function F'(t) 4 0 leads to an interference in the 
motion of the spring and will change the long-term or steady-state behavior 
of the spring. In the event that the frequency of the forcing is close to the 
natural frequency of the spring, a phenomenon called resonance occurs. In 
this situation the amplitude of the motion is amplified, sometimes dramati- 
cally. 


Electric Circuit 


In a second semester physics course, one of the topics students study is the 
flow of electrons. Two common things to consider are the amount of charge 
of these electrons or the change in the charge of the electrons. In considering 
the amount of charge, Q(t), we typically measure this in coulombs. For the 
change in the charge over time, that is I(t) = oe we call this the current 
and it is measured in amperes. The quantity that we choose to measure often 
depends on the components that we have in the circuit. A more common 
quantity used instead of charge is voltage, which is defined as the potential 
difference in charge between two points. To write our differential equation, 
we state the following conservation of energy law: 
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Kirchhoff’s law: the voltage changes through a closed path in a 
circuit must sum to zero. 


Circuits will typically have up to 4 different types of components: 
e a supplied voltage of € volts (denoted € for electromotive force or emf) 
e a resistor of resistance R ohms, where the voltage across it is RI 


e acapacitor of capacity C’ farads, where the voltage across it is 2 


dl 


e an inductance of L henrys, where the voltage across it is LZ, 


and we consider R,C,L > 0. If all the components are connected in series, 
the resulting differential equation is then 


’Q dQ, 1 


L 
dt? “ dt C 


Q=é. (3.62) 


We can equivalently rewrite this in terms of I by taking the derivative of each 
term: 


d?T dl 1 
L +} R— +1 =€'. 3.63 
dt? ( ) 
Perhaps a bit different from the spring analogy is the possibility of removing 
L from the circuit and still having a situation that make sense. 


Table 3.2: Comparison of Mass-Spring System & Electric Circuit 


Mass-Spring System | Electric Circuit 
mass inductance 
friction resistor 
spring capacitor 
location of mass current in circuit 


We thus consider the electric circuit in Figure 3.11, which we will consider 
in an analogous fashion to the mass on the spring; see Table 3.2. The direction 
of the current, J, traditionally denotes the flow of positive charge and thus 
flows in the direction opposite that of the moving electrons. The first case 
that is of interest to us is the one in which the switch is open for a while and 
then moves to position 2 at time t = 0. We can solve this with the methods 
of Section 3.6. Another situation that we could consider is if the switch is in 
position 1 for a while so that the supplied voltage (given as €) will supply a 
forcing current that depends on time. At time t = 0, we move the switch to 
position 2. We will thus have some initial current in the circuit apart from 
the other components. A final situation is when the switch is open for a while 
and then moves to position 1 at time t = 0. This is a forced differential 
equation that we will learn to solve in the next chapter. When we consider 
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Switch R 
2 > L 
I 
é 


FIGURE 3.11: Basic RLC circuit with differential equations (3.62) or, 
equivalently, (3.63). The components are connected in series. 


the homogeneous situation where there is no applied voltage, we can easily 
see that the characteristic equation of this circuit is Lr? + Rr + a, with roots 


-R, VP-46_ -R ay? 
a= a= OL — Wo; 


where Wo = Ts is called the resonant frequency of the circuit. These 
roots can be real and distinct, real and repeated, or complex. For the case of 


real and repeated roots, we have 


L 


R? —4— =0, 
C 
which can be rewritten as oa / c = 1. This motivates us to define a damping 


ratio, analogous to that of the mass-spring system, as 


i= ae -700. (3.64) 


where we additionally use a subscript e to denote our application to electric 
circuits. If we go back to our original equation (3.63), we can rewrite it using 
Ce and wo by first dividing by Z and then manipulating to obtain 


d?I dI 
ae t %ewog + wel = 0. (3.65) 


The roots of the characteristic equation are then easily found as 


r =u (-¢e+ VP=1). (3.66) 


Completely analogous to the mass-spring system, we will again have three 
different types of current to consider 


e overdamped: ¢ > 1, i.e., R? > 44 
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e critically damped: ¢ = 1, ie., R? =44 
e underdamped: ¢ < 1, ie., R? < 4k 


Thus, when there is no external voltage supplied (that is, E’ = 0), the presence 
of the resistor will cause the current to eventually go to zero. 


|Example 4| Consider the RLC circuit of Figure 4.3. If the values of the 


inductor, capacitor, and resistor are .5 henrys, .5 farads, and .2 ohms, re- 
spectively, determine whether the transient behavior of the circuit is over-, 
critically, or underdamped. 


Solution 
We want the current, which means that (3.63) would be the easier equation to 
use. Substituting the given values of L,C, R into the characteristic equation 


show that R? — _ = —1 <0 so that we are in the underdamped case. 
e e e e e e e e e e e e 
Problems 


1. A 12-lb weight is placed upon the lower end of a suspended coil spring. 
The weight comes to rest in its equilibrium position, stretching the spring 
1.5 in. The weight is then pulled down 2 in. below its equilibrium position 
and released from rest at t = 0. Find the displacement of the weight as a 
function of time; determine the amplitude, period, and the frequency of 
the resulting motion. Assume there is no resistance of the medium and 
no external force. 


2. A 16-lb weight is placed upon the lower end of a suspended coil spring. 
The weight comes to rest in its equilibrium position, stretching the spring 
6 in. The weight is then pulled down 4 in. below its equilibrium position 
and released at t = 0 with an initial velocity downward of 2 ft/sec. Find 
the displacement of the weight as a function of time; determine the am- 
plitude, period, and the frequency of the resulting motion. Assume there 
is no resistance of the medium and no external forces. 


3. A 6-lb weight is placed upon the lower end of a suspended coil spring. 
The weight comes to rest in its equilibrium position, stretching the spring 
6 in. At t = 0, the weight is set into motion with an initial velocity 
downward of 2 ft/sec. Find the displacement of the weight as a function of 
time; determine the amplitude, period, and the frequency of the resulting 
motion. Assume there is no resistance of the medium and no external 
force. 


4. A 10-lb weight is placed upon the lower end of a suspended coil spring. 
The weight comes to rest in its equilibrium position, stretching the spring 
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5 in. At t = 0, the weight is set into motion with an initial velocity 
downward of 3 ft/sec. Find the displacement of the weight as a function of 
time; determine the amplitude, period, and the frequency of the resulting 
motion. Assume there is no resistance of the medium and no external 
force. 


In Problems 5-12, we consider some mass-spring analogs. 


5. 


10. 


11. 


12. 


Two pulleys are attached to a shaft; they have moments of inertia 1, 
and Jj. To twist one of the pulleys an angle # with respect to the other 
requires an elastic shaft-deforming torque of K@. Find the frequency of 
the torsional oscillations of the shaft. 


. A weight of mass m is attached to one end of an elastic rod. The other 


end moves so that its position at time ¢ has coordinate Bsinwt. The 
elastic force exerted by the rod is proportional to the difference in dis- 
placements of its ends. Neglecting the mass of the rod, and friction, find 
the amplitude A of the forced vibrations of the mass. Can the relation 
A> B hold? 


. An electric circuit consists of a voltage source that supplies constant 


voltage V volts, a resistor of resistance R ohms, and an inductance of 
L henrys, together with a switch that is closed at time t = 0. Find the 
current as a function of the time. Assume I(0) = 0, I’(0)¥. 


. Solve the preceding problem, replacing the inductance L by a capacitor of 


capacity C farads. The capacitor is uncharged when the switch is closed; 


assume [(0) = y. 


. A resistor of resistance R ohms is connected to a capacitor of capacity C 


farads that has a charge Qo coulombs at time t = 0. The circuit is closed 
at t = 0. Find the charge as a function of time for t > 0. 


An inductor, resistor, and capacitor are connected in series. At time 
t = 0, the circuit is closed, the capacitor having a charge of Qo coulombs 
at that time and Q’(0) = 0. Find the current as a function of time and 
determine when there will be oscillations. 


A voltage source supplies a constant voltage in a circuit consisting of the 
voltage source, and a resistor and capacitor in series. Find the steady- 
state charge in the circuit. 


A voltage source supplies a constant voltage and is connected to a resistor, 
inductor, and capacitor in series. Find the steady-state charge in the 
circuit. 


Problems 13-21 discuss topics from the “Damped Oscillations” subsection. 
For each problem, classify the motion of the mass on a spring as either un- 
derdamped, critically damped, or overdamped. Assume x = «(t), that is, x 
is a function of t. 
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13.2”+2'+2=0 14.4¢”4+¢'4+37=0 15.2”+4+4e'4+327 =0 
16.2"+52’+2=0 17.02” +227'’+2=0 18.2” + 627’ + 9x7 =0 
19. 32” +62’ +¢2=0 20.27”4+32'+9r=0 21.92” — 1227’ +4r = 0 


22. For both overdamped and critically damped motion, it is still possible for 
the mass to pass through its rest position at most one time before coming 
to rest. Use the general solution of the damped mass-spring system to 
show that the respective conditions are given by |vo| > |xorg| and |vo| > 
|bag /(2m)|, where vp (the initial velocity of the mass) and xo (the initial 
displacement) have opposite sign, and rg = (—b — Vb? — 4mk)/2m is the 
smaller root of the characteristic equation. 

23. In a first physics course, the motion of a damped spring is often given as 


k k 
a(t) & cye—*/2™ cos (y+) age sini (\ xs) : (3.67) 
m m 


with the qualification that this approximation is valid if the damping 
constant b is small. Verify this approximation by using a Taylor series 
expansion about b = 0. 


In Problems 24—29, consider the roots from mass on a spring equation, (3.52). 
Two of the constants m, b,k are given. Determine the range on the remaining 
one that will result in the described motion. 

24.m = 1,b =3, overdamped 25.m = 1,b = 2, underdamped 

26.m = 2,k = 2, critically damped 27.m=1,k =8, critically damped 
28. b= 3,k = 2, underdamped 29. b= 2,k = 2, overdamped 


In Problems 30-34 involve numerical explorations with the computer. They 
concern the generalized equation of motion for a mass on a spring given by 


m(t)a"(t) + b(t)a’(t) + k(t)a(t) = F(t). 


Here, we allow the possibility of changing mass, coefficient of friction, and 
spring constant, as well as a forcing function. Thus, we will not be able to 
use b? — 4mk to determine the motion of the spring and we will instead use 
the computer to find the numerical solution. 


30. Consider a container attached to a spring. Suppose the container is full 
of water that is evaporating in the hot Los Angeles sun. Suppose the 
mass function is given by m(t) = 2e~*/19 + 1. Let b(t) = .2, k(t) = 1, 
and F(t) = 0. Plot numerical solutions from t = 0 to t = 50 from the 
initial conditions x(0) = 1, «’(0) = 0. 

31. Consider a block of constant mass m = 2 sliding back and forth on a 
sheet of ice. As the block slides, the ice melts and eventually exposes 
a rougher surface beneath. Assume the damping coefficient is given by 
b(t) = arctan(t — 20) + 7/2. Let k(t) = 4, F(t) = 0. Plot the motion of 
the spring over a large enough range for ¢ so that you are able to see the 
results. Assume x(0) = 1, «’(0) =0. 


32. 


33. 


34. 
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Springs typically lose some of their stiffness over time. Suppose a spring 
coefficient is given by k(t) = 5e~*/25. Suppose also that b(t) = 1, m(t) = 
12, F(t) = 0. Plot the motion of the spring over a large enough range for 
t so that you are able to see the results. Assume «(0) = 1, 2’(0) = 0. 


Consider the equation 4x” + 0.12’ + 4a = sin(wt). (i) Let w = 10. What 
happens to the motion for large t? Does it decay to zero? (ii) Now let 
w= 1. Again, what happens to the motion for large ¢? (iii) Numerically 
explore the behavior of the solution for various w-values. Is there an 
w-value that gives the largest oscillations? 


Consider the equation 4a + a + 4a = sin(wt). (i) Let w = 10. What 
happens to the motion for large t? Does it decay to zero? (ii) Now let 
w= 1. Again, what happens to the motion for large ¢? (iii) Numerically 
explore the behavior of the solution for various w-values. Is there an 
w-value that gives the largest oscillations? 


Chapter 3 Review 


In Problems 1-6, determine whether the statement is true or false. If it is 
true, give reasons for your answer. If it is false, give a counterexample or 
other explanation of why it is false. 


1. 


The Existence and Uniqueness theorem allows us to state that the solu- 
tion to xy” —y = 0 passing through the initial condition y(0) = 0, y’(0) = 
1 will not be unique. 


. The Existence and Uniqueness theorem allows us to state that the so- 


lution to y” — y = cosha passing through the initial condition y(0) = 
0, y’(0) = 1 will not be unique. 


. Reducing the order of a differential equation requires the knowledge of a 


solution. 


. A mass on a spring system can be written as ma’’(t) + ba’ (t) + ka(t) for 


constants m, b, k € (—co, ov). 


. All differential operators commute; that is, if P(D)Q(D) = Q(D)P(D). 


. Only nth-order linear differential equations can be rewritten as a system 


of first-order equations. 


In Problems 7-9, determine whether the differential equation is guaranteed 
to have a unique solution passing through the given initial condition. Then 
try to find constants to make the proposed function y a solution to the IVP. 


7. 


y” —4y =0, y(0) = 4, y'(0) = 0; y = cre?*® + Qe" 
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8. y" —2y +y= aa , yy) = 0,y’(1) = 1; y = cre® + cove” + e* x(In ax — 1) 
x 
(with x > 0) 
9. xy” — 2y =0, y(0) = 1,y'(0) = 1; y= cz? + c24 


In Problems 10-13, find all values of (x,y) where Theorem 3.1.1 guarantees 
the existence . a unique solution. 
10. y” + 3ay' +y = SB 11. 3y"” +52?y +y=4 


ex 


12. y" + 7x?y = sine 13. y" — In|aly’ + 2y = 241 


In Problems 14-22, determine whether the following sets of functions are 
linearly independent for all 2 (where the functions are defined). 

14. {32 —2,2+1} 15. {x+1,27-1} 16. {e’,2 +1} 

17.12" 2} 18. {sin x, tan x} 19. {Inz,« — 1} 

20. {./x — 42, x, 2x} 21. {x? — 4a, 3a, x7} 22. {2,cos? x, sin” x} 


In Problems 23-29, determine whether the given set forms a fundamental 
set of solutions to the differential equation on (—oo,co). Clearly state your 
reasons for your answers. 

23. {e37, 637}, y” — 9y =0 24. {e%,e~ 27}, y” — yy’ — 2y =0 

25. {e-*,e°7}, (D? -6D + 5)(y) =0 26. {e7, ze7}, (D+ 1)?(y) =0 

27. {e3 sin x, e?* cos x}, y” — 6y’ + 10y = 0 

28. {e?” sin 2x, e?* cos 2x}, (D? -4D + 8)(y) =0 

29. {e?* sin x, e?” cos x, 3}, y” — 6y” + 10y’ =0 


In Problems 30-34, use the given solution, yi, to reduce the order of the 
differential equation. Find a second solution. 

30. y” + 4y’ + 4y =0, y. = e277 31. y” —4y’ —5y =0, y. =e-* 
32. y” + 2y’ — 35y = 0, x, =e” 33. y” + 10y’ + 25y = 0, yi =e” 
34. y” + 10y + 9y =0, y, =e” 


2x 


In Problems 35-40, rewrite the following differential equations using operator 
notation and factor completely. 


35. a y’ ~ ay =0 36. yr — by" + Ay’ =0 

37. — l6oy' =0 38. + 3y" —4y =0 

39 an 3 if ! = on ais oj A = 
.y —3y'+3y —y=0 40. y sy +3y +1=0 


In Problems 41-46, (i) convert the equations to a system of first-order equa- 
tions; (ii) use your software package and the given initial conditions at 29 to 
estimate the numerical solution at the value x = x) + 5.0 for the step sizes 
h=0.1. 

41. y"” — 4y' + 3y =0, y(0) =0,y/(0) =1 


42. ay" +y' =0, y(0) =1,y'(0) = 0,y"(0) = 
43. 0?y'" — 2y =0, y(1) =0,y'(1) =0,y"(1) =1 
44.y" +siny =0, y(0) =1,y/(0) =1 
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45. y" + (1—y?)y’ + 2y = cosa, y(—1) =1,y/(-1) = 1 
46. y” + 2y’+siny = 0, y(0) = 3,y/(0) =1 


In Problems 47-50, write the given function as the real part or imaginary 
part of a complex-valued function. 


AZ. 3sin2x A8. cos wt AQ. ec?" cosaz 50. e~* sin 2a 


In Problems 51-54, evaluate the polynomial at the given complex number. 


1 . : 1 a 
OL De) = Sao 52. plz) = esa" i 
e* = e* : 
53. p(z) = 240 31, 2 54. p(z) = a ae 2i, 1-1 


Write the general solution of the equations given in 55-62. 


55. y” — 5y’ + by = 0 56. y” — 3y' — 10y =0 
57. D2(D +.1)(D—4)(y) =0 58. (D? + 1)(D — 2)(y) = 
59. D(D + 1)3(y) =0 60. (D — 1)?(D + 2)(y) = 
61. D(D + 7)(D? — 4)(y) =0 62. (D? — 27)(y) =0 


Find the solution of the [VPs given in 63-69. 
63. y” + by’ + 9y = 0, y(0) = 1, y’(0) =0 

64. y” + 1ly’ + 10y = 0, y(0) = 1, y/(0) = -1 
65. y” + Gy’ + 8y = 0, (0)-= 1,y’(0) = —-1 


66. y” + 2y’ + 2y = 0, y(7) = 0, y/(7) = 1 

67. y" + 4y’ + 13y =0 y(m/2) = 2, y/(7/2) = 1 

68. (Dp +4D)(y) = 0, y(0) = 0, y/(0) = Ly 0) =0 
69. (D3 + D)(y) =0, y(0) = 2, y’(0) = —1, y”(0) =0 


For Problems 70-81, classify the motion of the mass on a spring as either 
underdamped, critically damped, or overdamped, or find the range of the 
parameter value that will give the desired result. Assume x = x(t), that is, x 
is a function of f. 


70.7" +2'=0 TW1.0"4+4¢'+27=0 
72.0" + 32/+2=0 73.20" 4+32' +22 =0 
74. 20" 4 82'+ 8x =0 75.2” +102’ + 252 =0 


76. x" + ba’ +42 = 0, underdamped 

77. x + ba’ + 42 = 0, overdamped 

78.2" +32’ + kx =0, underdamped 
79.20" +2'+kx =0, critically damped 
80. mx” + 7x’ + 3x = 0, overdamped 

81. ma” + 2x’ + 4a = 0, critically damped 
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Chapter 3. Computer Labs 


Chapter 3 Computer Lab: MATLAB 


MATLAB Example 1: Enter the code below to demonstrate, using 
Symbolic Math Toolbox, the following: 

a) the functions f(z) =1+382, fo(z) = 4-227, f3(x) = 5x — 2? are linearly 
independent; 

b) the functions gi(x) = 2+, fo(z) =4—2+ 527, g3(x) = 2 — 5x + 102? 
are linearly dependent. 


== Glleeie alll 

>> syms x cl c2 c3 c4 

>> £1=1+3*x 

>> £2=4-2+x/\2 

>> £3=5*x-x’2 

S> eqil=cil*f1+c2*f2+c3*f3 

>> eq2=coeffs(eqi,x) 

>> eq3=solve(eq2(1)==0,eq2(2)==0,eq2(3)==0) 

SS Gileees.ci 

SS C2S6G8) 5 2 

>> c3=eq3.c3 

>> %Thus the only c-values that will work are cl=c2=c3=0. 
>> It follows that the three functions are lin. independent. 
==> Gllesie ellll 

>> syms x cl c2 c3 c4 

>> gil=2+x 

>> g2=4-xt+5*x/2 

>> g3=2-5*x+10*x2 

>> eq4=ci*gl+c2*g2+c3*g3 

>> eqb=coeffs(eq4,x) 

>> eq6=solve(eq5(1)==0,eq5(2)==0,eq5(3)==0) warning appears 
>> ci=eq6.ci 

SS C2569. 62 

>> c3=eq6.c3 

>> %z is arbitrary. With z=1, we have 3*g1-2*g2+1*g3=0. 
>> %Thus the three functions are linearly dependent. 
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MATLAB Example 2: Enter the following code that demonstrates how to 


calculate the Wronskian, W(x), of the functions fi(a#) = e”, fo(x) = e-*, 
fs3(x) = e?*. For linear independence, we need W(x) # 0 for at least one 
a-value. It uses the Symbolic Math Toolbox. 


= 
= 
= 
= 
= 
= 
Se 
Le 
= 


clear all 

syms x 

f1=exp (x) 

f2=exp (-x) 

£3=exp (2*x) 

diff([f1 £2 £3],x) %2nd row of Wronskian 

Nealiaedl 12) sso Glalsese ( [ei se D384] ,3e) 6 Glisew ( (Lei) 7D se Si] ,32,)) || 
Wronsk=det (A) 

subs(Wronsk,x,0) %This calculates W(0). 


MATLAB Example 3: Enter the following code that demonstrates how to 


perform calculations with complex numbers using the Symbolic Math Toolboz. 


LE 
= 
LE 
= 
= 
= 
= 
= 
S 
LE 
= 
= 
= 
= 
= 
=> 
= 
= 
= 
= 


clear all 

syms ri r2 z x Al A2 
ri=2+3*i 

real(r1) 

imag (r1) 

conj (r1) 
r2=1/(4+5*i) 

exp (3+4*i) 

exp (pi*i) 

z=1-3*i 

R=abs (z) 
theta=angle(z) 
R.*exp(i*theta) 

f (x)=x"%4 

solve (f(x)-pi,x) 
p(x) =x 2+6*x+25 
solve (p(x) ,x) 

subs (p(x) ,x,i) 

subs (p(x) ,x,2+i) 
[solA1, solA2]=solve((2+i)*A1==3, A1+3*A2*i==0) 


MATLAB Example 4: Enter the following code that uses RK4 (previously 


created, or use ode45) to numerically solve the following ODEs and then 
plots their solutions: 
(a) 2ay"” + 2?y' + 3a3y = 0, with y(1) = 2, y'(1) =0; 
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(b) y + a?y! + y = cos(x), with y(0) = 1, y'(0) = 0, y"(0) = 0, y/"(0) = 1. 
Give the numerical value of the solution at « = 5. You will need to convert 
each ODE to a system of first-order equations. 


%Create the function Ch3NumExample1 .m: 
function dy= Ch3NumExamplel (x,y) 

% 

%The original ode is 2*x*y” +x/2*y’+3*x/3*y=0 
%The system of first-order equations is 


%ul’=u2 
%u2’=(-x/2)*u2-((3*x*2)/2)*ul 

% 

%We let y(1)=ul, y(2)=u2 

% 

dy=zeros(2,1); Yody is a column vector! 
dy(1) = y(2); 


dy(2) = (-1/2)*x*y(2)-(3/2)*x*2*y(1); 
%end of function Ch3NumExamplel.m 


%Create the function Ch3NumExample2.m: 
function dy= Ch3NumExample2(x,y) 

% 

%The original ode is y*(4)+x2*y’+y=cos(x) 
%The system of first-order equations is 
%ul’=u2 

Au2’=u3 

%u3’=u4 

%ud’=-x’2*u2-u1+cos(x) 

% 

%We let y(1)=ul, y(2)=u2, y(3)=u3, y(4)=u4 
% 

dy=zeros(4,1); Yody is a column vector! 

dy(1) = y(2); 

dy(2) = y(3); 

dy(3) = y(4); 

dy(4) = -x2*y(2)-y(1)+cos(x); 

%end of function Ch3NumExample2.m 


After having created and saved the above two functions, type the following 
in the Command Window. 

>> clear all 

>> x0=1; xf=5; 

>> y0=[2,0]; 
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>> [x1,y1]=RK4(@Ch3NumExample1, [x0,xf] ,y0, .05); 

SS stigjollon(@, i, i) jolts Gal wile 11) 

>> xlabel(’x’); ylabel(’y’) 

SS slljolon@, 1,2) jollowGal wil (3 -2)) 

SS seleloail(s?)) 5 wWileloail wy?) 

>> [xt(end), y1i(end,:)] %This shows the last entry of 
vector xi and matrix yl. Note that we set xf=5. 

>> figure /%calls a new blank figure window 

>> x0=1; xf=5; 

>> y0=[1,0,0,1]; 

>> [x2,y2]=RK4(@Ch3NumExample2, [x0,xf] ,y0,.05); 

>> plot(x2,y2) 

SS logemcl(yC” vO)? .°7@)? ?vw¥EX)”? 

>> xlabel(’x’); ylabel(’y-values’ ) 

>> [x2(end), y2(end,:)] 

>> figure 

>> [x2,y2]=ode45 (@Ch3NumExample2, [x0,xf],y0); “Or use ode45. 

>> plot(x2,y2) 

>> legend(’y(1)’,’y(2)’,’y(3)’,’y(4)’) 

>> xlabel(’x’); ylabel(’y-values’) 

>> [x2(end), y2(end,:)] 


MATLAB Example 5: Enter the code below to demonstrate, using 
Symbolic Math Toolbox, how to find the roots of the characteristic equation 
of the given homogeneous ODEs. 

(i) y” + 3y' — 4y = 0 

(ii) y — 4y"” + 6y” — 4y’ — 15y =0 

(iii) y +y/” — 2y/ —y =0 

(iv) y’” +y' — 3y =0 

(v) y + 38y” —y = 

You will need to first write the characteristic polynomial in order to find the 
roots, which are not necessarily real-valued. 


a> Gll@eir gull 

>> Next three lines do NOT require the Symbolic Math Toolbox 
>> p=[1 0 30 1] %these are the coefficients in (v) 

>> if a coefficient is 0, you must put 0 in its position 

>> roots(p) 

>> %Now we use the Symbolic Math Toolbox: 

>> syms x r 

>> f(r)=r*2+3«r-4 

>> solve(f(r),r) 

>> g(x)=r%4-4*r%3+64r%2-4r-15 
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= 
= 
= 
= 
= 
=> 
= 
=> 
=> 
= 
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solve(g(r) ,r) 

h(r)=r4+r3-2*r-1 

solve(h(r) ,r) 

F(r)=r/3+r-3 

Fsoln=solve(F(r) ,r) 

Fsoln(1) % This is the first root 
double (Fsoln(1)) 

double (Fsoln) 

G(r) =r%5+3%r 2-1 
Gsoln=solve (G(r) ,r) 


MATLAB Exercises 

Turn in both the commands that you enter for the exercises below as well as 
the output/figures. These should all be in one document. Please highlight or 
clearly indicate all requested answers. Some of the questions will require you 
to modify the above MATLAB code to answer them. 


il, 


10. 


Enter the commands given in MATLAB Example 1 and submit both your 
input and output. 


. Enter the commands given in MATLAB Example 2 and submit both your 


input and output. 


. Enter the commands given in MATLAB Example 3 and submit both your 


input and output. 


. Enter the commands given in MATLAB Example 4 and submit both your 


input and output. 


. Enter the commands given in MATLAB Example 5 and submit both your 


input and output. 


. Determine whether the following functions are linearly independent: 


a) fi(x) =24+ 54 — 327, fo(z) =2—a2+27, f3(x) = —2 — 23a + 1527; 
b) fi(z) =1+42 + 227, fo(x) =3-—2+4 227, f3(x) = 5 — 2x — 227. 


. Determine whether the following sets of functions are linearly indepen- 


dent: 
a) {14+22-3274+23,2—2+27+323,-4+2—-274223, —624+827+92}; 
b) {84+ 4a — 3a? + 23,2 — 227 +423,-4+ 27 —23,-4—-52 —27 +323}. 


. Use the Wronskian to determine whether the following sets of functions 


are linearly independent. 
a) {cos x,3cos a + sin 2x, sin x} (b) {cos x,3cosx +sinz,4sin x}. 


. Use the Wronskian to determine whether the following sets of functions 


are linearly independent. 

ale ate’ a} (b) {sin(4x) + cos(4a), cos(4x) — sin(4)}. 

Any number can be written in polar form in the complex plane, re’’. 
Find the r and @ values corresponding to the polar form of the following 


ia, 


2, 


1133, 


14. 


15. 


16. 


iff, 


18. 


il), 


20. 


Pile 
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complex numbers. 
(a) 2— 32 (b) 22 (c) -1— 52 (d) 3+% 
Any number can be written in polar form in the complex plane, re’. 
Find the r and @ values corresponding to the polar form of the following 
complex numbers. 
(a) 2+ 32 (b) —3% (c) -2-% (d) 34 7i 
Consider the polynomial p(z) = z7 + 4z +8. Evaluate it at the following 
values: 
(Q) gs (b) z=3-2 (c) z=-144i (d) z=—2+ 2% 
Consider the polynomial p(z) = z* — 1. Evaluate it at the following 
values: 
(@) 2= 28 (b) z=3-2 (c) z=-144i @) ssi 
Solve the following systems of equations, where A;, Ag may be complex- 
valued numbers. 
a (2+i)Ai + A2=3 On ety ee 
A; + 3Agi = 0 Ay — Agi = —1 

Solve the following systems of equations, where A;, Ag may be complex- 
valued ees ; niet 

il = 12 — = 
ea = Oe. 
For y’ + y' +y = 0 with y(0) = 1,y/(0) = 2, use a stepsize of h = 0.1 
to obtain the solution from the 4th order Runge-Kutta method. Plot the 
solution for 0 < x < 20. Give the numerical value of the solution at 
fe = 70), 
For y” + 2y’ + 17y = sin(2x) with y(0) = 0,y’(0) = 0, use a stepsize of 
h = 0.1 to obtain the solution from the 4th order Runge-Kutta method. 
Plot the solution for 0 < x < 20. Give the numerical value of the solution 
ent ae = 20), 
For y/” + 4y” + 21y’ + 34y = cos(3x) with y(0) = 1, y/(0) = 0, y”(0) = .5, 
use a stepsize of h = 0.1 to obtain the solution from the 4th order Runge- 
Kutta method. Plot the solution for 0 < x < 20. Give the numerical 
value of the solution at x = 20. 
For y!” + x74" + y = sin(x) with y(0) = 1, y'(0) = —2,y”(0) = 1, use a 
stepsize of h = 0.1 to obtain the solution from the 4th order Runge-Kutta 
method. Plot the solution for 0 < x < 20. Give the numerical value of 
the solution at x = 20. 


Find the roots of the characteristic equation of the following homogeneous 
ODEs: (a) y”+y/+y =0 (b) y!” + 8y” + 37y' + 50y = 0 (c) 
y\4) — ay) — dy” + 36y/ — 638y = 0 
Find the roots of the characteristic equation of the following homogeneous 
ODEs: (a) y/’ + 2y’ + 17y (io) gf! — af” 46 likey’ — Silgy = C (c) 
Ay(4) — dy) + 13y” — 4y' — 9y = 0 
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22. Find the roots of the characteristic equation of the following homogeneous 
ODEs: (a) yl” + 4y” aL 21y! ai 34y (b) y) a, 3y at Oy!” aL 27y" = 
(c) 4y©) + 124) + 254” + 12y” + 217/ = 0 
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Maple Example 1: Enter the code below to demonstrate the following: 

a) the functions fi(z) = 1+32, fo(x) = 4-22, fs(x) = 5a — <2? are linearly 
independent; 

b) the functions g;(x) = 2+, fo(z) =4—2+ 527, g3(x) = 2— 5a + 10x? 
are linearly dependent. 


restart 

fit=zo14+3-2 

fo =r 4-2-37 

fg:=a35-a-2 

eql [= Cy f(z) aF OR ° fa(a) SP G3 2 f3(x) 

eq2 := collect(eq1, [x, x”]) 

eq3a := coeff( eq2, x, 2) 

eq3b := coeff( eq2, x, 1) 

eq3c := coeff( eq2, x, 0) 

eq4 := solve({ eqg3a = 0, eq3b = 0, eg3c = 0}, {c1, C2, c3}) 
#Thus only 0-f1 +0-f2 +0-f3 gives 0. 

Gi, SS Se Bk ae 

g2 =@3>4—-a24+5-2? 

g3 = 23 2-—5-24+10-2? 

egd = Cy - gi(X) + Cg + go(x) +3 - g3(Zz) 

eq6a := coeff(eq5, x, 2) 

eq6b := coeff( eq5, x, 1) 

eq6c := coeff( eq5, x, 0) 

eq7 := solve({ eq6a = 0, eq6b = 0, eq6c = 0}, {c1, C2, c3}) 
#c3 is arbitrary. Thus with c8 =1, we have 3-g1 -2-g2 +1-g8=0. 


Maple Example 2: Enter the following code that demonstrates how to 
calculate the Wronskian, W(x), of the functions fi(#) = e”, fo(x) = e~*, 
f3(x) = e?*. For linear independence, we need W(x) # 0 for at least one 
x-value. 
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restart 

with (LinearAlgebra) #Loads the needed linear algebra package 
fi = Se 
for= Ute 
fg:= ae 


A= Matric |[fa(a) fle), fale) Se (UsC@), fala) C0). 


x 


Stile), fae), Ja))]) 


Wronsk := simplify(Determinant(A)) 
simplify(subs(x = 0, Wronsk)) 


Maple Example 3: Enter the following code that demonstrates how to 
perform calculations with complex numbers. 


restart 

T1:=24+3-] 

Re(r1) 

Im(r1) 

consusa ca) 

4+5-I 
fee! 

evalc( f1) 

ene 

6% i=Doll 

R := abs(z) 

0 := argument(z) 
Bete 

f:=a7x* 

solve( f(x) = 7,2) 
pi=x3 2? +6-2425 
solve(p(x), x) 

subs(x = I, p(x)) 

subs(x = 2+I,p(a)) 
solve({(2 + I) Ay = 3, A +3- Ag Sy 0}) 


TQ = 


Maple Example 4: Enter the following code that uses Maple’s built-in 
Runge-Kutta method to numerically solve the following ODEs and then plots 
their solutions: 

(a) 2ay"” + 2?y’ + 3a°y = 0, with y(1) = 2, y'(1) =0; 

(b) y + 2?y’ + y = cos(x), with y(0) = 1, y’(0) = 0, y"(0) = 0, y’”(0) = 1. 
Give the numerical value of the solution at x = 5. 
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restart 
with(plots): 
with( DEtools): 
eqi :=2-2-y" (x) +27-y'(z) +3-2°-y(z) =0 
LCi <= ail) = 2, Day) = C 
DEplot(eq1, y(x), x = 1..6, [[IC I], stepsize = .05) 
#If we just needed a plot (and not the soln at 5), we could can use DEplot. 
#If we need to plot and we need the soln at 5, we use dsolve and odeplot. 
soln1 := dsolve ({IC1, eq1}, y(x), numeric, method = classical|rk4], 
stepsize = .05) 
soln1(5.0) 
odeplot( soln, |x, y(x)], 1..6, numpoints = 300) 
eg2 = yO (x) + 2? -y'(z) + y(a) = cos(z) 
102 := y(0) = 1,D(y)(0) = 0, D(D(y))(0) = 0, D(D(D(y)))(0) = 1 
DEplot(eq2, y(x), x = 0..6, [[IC2]], stepsize = .05) 
soln2 := dsolve ({IC2, eq2}, y(x), numeric, method = classical|rk4], 
stepsize = .05) : 
soln2(5.0) 
odeplot(soln2, |x, y(x)], 0..6, nwmpoints = 300) 


Maple Example 5: Enter the code below to demonstrate how to use Maple 
to find the roots of the characteristic equation of the given homogeneous 
ODEs. Although there is a built-in command to solve these, we will only use 
the computer to simplify our by-hand steps. 

(i) y” + 3y’ — 4y = 0 

(ii) y — 4y!” + 6y"” — 4y' — 15y = 0 

(iii) y + y” — 2y' —y =0 

(iv) y+ y' — 3y =0 

(v) y® + 3y”—y =0 

You will need to first write the characteristic polynomial in order to find the 
roots, which are not necessarily real-valued. 


restart 
fr=ror'+3-r-4 
fsoln := solve(f(r), 1) 
—rJ, ale 
gsoln := solve(g(r), 1) 
hi=rarttre—Q-r-1 
hsoln := solve(h(r),r) 
hsoln1 := allvalues(hsoln[1]) 
evalf(hsoln1) 

hsoln2 := allvalues(hsoln|2]) 
evalf(hsoln2) 


6-r?—4-r—15 
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hsoln3 := allvalues(hsoln|3]) 
hsoln4 := allvalues(hsoln|4]) 
P:=rort+r—3 

Fsoln := solve(F(r),r) 
Fsoln1 := allvalues( Fsoln{1]) 
evalf( Fsoln1) 

evalf( F'soln) 
G:=ror43-r?-1 
Gsoln := solve(G(r),1r) 
allvalues( G'soln{1]) 

evalf( Gsoln) 


Maple Exercises 

Turn in both the commands that you enter for the exercises below as well as 
the output/figures. These should all be in one document. Please highlight or 
clearly indicate all requested answers. Some of the questions will require you 
to modify the above Maple code to answer them. 


1. Enter the commands given in Maple Example 1 and submit both your 
input and output. 
2. Enter the commands given in Maple Example 2 and submit both your 
input and output. 
3. Enter the commands given in Maple Example 3 and submit both your 
input and output. 
4. Enter the commands given in Maple Example 4 and submit both your 
input and output. 


5. Enter the commands given in Maple Example 5 and submit both your 
input and output. 


6. Determine whether the following functions are linearly independent: 
(a) fi(z) =24+ 52 — 327, fo(x) =2-—ax+ 27, f3(x) = —2 — 23a + 1527; 
(b) fa(z) =1+4a +227, fo(x) =3—a2 +227, f(x) = 5 — 2x — 227. 
7. Determine whether the following sets of functions are linearly indepen- 
dent: 
(a) {1427-327 +23, 2—2+27+32?, -4+2—27+22°, —62+827+92°}; 
(b) {3+ 4a — 32? +23, a — 2a? +473, -4+4+ 2? —23,-4- 52-2? +323}. 
8. Use the Wronskian to determine whether the following sets of functions 
are linearly independent. 
(a) {cosa,3cos x + sin 2x, sin x} (b) {cosx,3cosz +sinx,4sin x}. 


9. Use the Wronskian to determine whether the following sets of functions 
are linearly independent. 
(a) te", we" a} (b) {sin(4x) + cos(4a), cos(4x) — sin(4x)}. 
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10. 


11. 


i. 


13. 


14. 


15. 


16. 


ile 


18. 


il), 


20. 
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Any number can be written in polar form in the complex plane, re’’. 


Find the r and @ values corresponding to the polar form of the following 
complex numbers. 

(a) 2— 32 (b) 22 (c) -1— 54 (d) 3+% 

Any number can be written in polar form in the complex plane, re’’. 
Find the r and @ values corresponding to the polar form of the following 
complex numbers. 

(a) 2+ 32 (b) —3% (c) —2-—4 (d) 3+ 7% 

Consider the polynomial p(z) = z? +4z+8. Evaluate it at the following 
values: 

(@) 2=2i (b) z= 3-27 (c) z=-144i (d) z= —-24 2% 
Consider the polynomial p(z) = z3 — 1. Evaluate it at the following 
values: 

(@) 2=2i (b) z=3-2 (c) z=-14+4 (@) g=1 

Solve the following systems of equations, where A;, Ap may be complex- 
valued numbers. 

@ (2+%)A, +A2=3 (b) 2A,+A2=3 

a A, + 8Aqi = 0 Ay — Agi = i 

Solve the following systems of equations, where A;, A2 may be complex- 
valued erasers r 4 

ie 2 = il yt — 2 — i 

NT 20 Onn Seer 

For y+ y' +y = 0 with y(0) = 1,y/(0) = 2, use a stepsize of h = 0.1 
to obtain the solution from the 4th order Runge-Kutta method. Plot the 
solution for 0 < x < 20. Give the numerical value of the solution at 
qe = AN). 

For y” + 2y/ + 17y = sin(2a) with y(0) = 0,y’(0) = 0, use a stepsize of 
h = 0.1 to obtain the solution from the 4th order Runge-Kutta method. 
Plot the solution for 0 < x < 20. Give the numerical value of the solution 
at x = 20. 

For y’” + 4y” + 21y’ + 34y = cos(3x) with y(0) = 1, y/(0) = 0, y”(0) = .5, 
use a stepsize of h = 0.1 to obtain the solution from the 4th order Runge- 
Kutta method. Plot the solution for 0 < x < 20. Give the numerical 
value of the solution at 7 = 20. 

For y!” + 2?y" + y = sin(x) with y(0) = 1,y/(0) = —2,y""(0) = 1, use a 
stepsize of h = 0.1 to obtain the solution from the 4th order Runge-Kutta 
method. Plot the solution for 0 < x < 20. Give the numerical value of 
the solution at 7 = 20. 

Find the roots of the characteristic equation of the following homogeneous 
ODEs: (a) y’ +y’+y =0 (b) y/” + 8y” + 37y/ + 50y = 0 (c) 
y4) — 4y(3) — 2y” + 36y’ — 63y = 0 
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21. Find the roots of the characteristic equation of the following homogeneous 
ODEs: (a) y/’ + 2y’ + 17y (b) y’” — y” + 1ly’ — 5ly = 0 (c) 
Ay(4) — dy) + 13y” — 4y' — 9y = 0 

22. Find the roots of the characteristic equation of the following homogeneous 
ODEs: (a) y’” + 4y” + 21y’ + 34y (b) y) + 3y 4+ Oy” + 27y" = 0 
(c) 4y©) + 12y + 25y/” + 124" + 21y/ = 0 
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Mathematica Example 1: Enter the code below to demonstrate the 
following: 

(a) the functions f;(~) =1+32, fo(z) =4—227, f(x) = 5a — 2? are linearly 
independent; 

(b) the functions g(x) =2+42, fo(x) =4—-2+4+ 527, g3(x) = 2— 5x 4+ 10x? 
are linearly dependent. 


Quit|] 
filx_] = 1+ 3x (*don’t forget <space> for multiplication*) 
PA] Ss A= De 
£3[x ] = 5x - x? 
egil = eilzillb] + C2F2lbel] + eh 
eq2 = Collect[eqi, {x, x?}] 
eq3 = CoefficientList[eq2, x] 
eq3a = Coefficient[eq2, x, 2] 
eq3b = Coefficient[eq2, x, 1] 
eq3c = Coefficient[eq2, x, 0] 
eq4 = Solve[{eq3a==0, eq3b==0, eq3c==0}] 
(*Thus only Of1 +0f2 +0f3 gives 0.*) 
ells _]] = 2 cr xz 
Pele Se = eae sa 
Pele (| =o bye ae alee 
eqS = clgi[x] + c2g2[x] + c3g3[x] 
eq6 = CoefficientList[eq5, x] 
eq? = Solve[{eq6[[1]]==0, eq6[[2]]==0, eq6[[3]]==0}] 
(*c1 is arbitrary. Thus c1=3 (e.g.,) gives 3g1-2g2+1g3=0.*) 


Mathematica Example 2: Enter the following code that demonstrates how 
to calculate the Wronskian, W(«), of the functions fi(”) = e”, fo(a) =e”, 
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f3(x) = e?*. For linear independence, we need W(x) 4 0 for at least one 
x-value. 


Quit| |] 

ceil (ise | = oe 
£2 [|= em 
&lbe_] = es 


Wronskian[{filx], f2[x], f3[x]}, x] 


Mathematica Example 3: Enter the following code that demonstrates 
how to perform calculations with complex numbers. 


Quit| | 
(*Recall that e, i, m are entered from the palette*) 

gi, = 2 <p Sal 
Re[r1] 
Im[r1] 
Conjugate [r1] 
eee 

445i 
fi = est4i 
ComplexExpand [f1] 
eit 
va = il = Sal 
R = Abs([z] 
0 = Arg([z] 
Rei? 
ComplexExpand[%] 
#\ibz 1) = x 
Solve[f[x]==7, x] 
p(x_] = x? + 6x + 25 
Solve[p[x]==0, x] 
ReplaceAll[p[x], x—i] 
ReplaceAll[p[x], x—2t+i] 
Solve[{(2 + i) Al==3, A1 + 3A2i==0}] 


Mathematica Example 4: Enter the following code that uses Mathemat- 
ica’s built-in Runge-Kutta method to numerically solve the following ODEs 
and then plots their solutions: 

(a) Qay” + 27y' + 32°y = 0, with y(1) = 2, y/(1) = 0; 

(b) yh) + oy’ yy = cos(x), with (0) = 1, (0) = 0, y’(0) = 0, y’"(0) = 1. 
Give the numerical value of the solution at x = 5. 
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Quit|] 

detix I) = 2xy? ix) ty xl 4 ox ylxl 

solutionl = NDSolve[{dei[x]==0, y[1]==2, y’[1]==0}, y, 
{x, 0, 6}, StartingStepSize— .05, Method—{FixedStep, 
Method—+ExplicitRungeKutta}] 

yilx_] = y[x]/.solution1[[1]] 

yi[5] 

Piles sil (ell, {35 Oy Shy emcclabol ue Mee ty tll 

de2izel) = y7? xl = xy? bel 4 yal 

solution2 = NDSolve[{de2[x]==Cos[x], y[l0]==1, y’ [0]==0, 
y’’? LO]==0, y’’’ [O]J==1}, y, {x, 0, 6}, StartingStepSize—.05, 
Method—{FixedStep, Method—ExplicitRungeKutta}] 

y2[x_] = ylx]/.solution2[[1]] 

y2[5] 

Plot ly2[x], {x, 0, 6},PlotRange—{-6, 25},AxesLabel—>{"x", "y"}] 


Mathematica Example 5: Enter the code below to demonstrate how to 
use Mathematica to find the roots of the characteristic equation of the given 
homogeneous ODEs. Although there is a built-in command to solve these, 
we vl only use the computer to simplify our by-hand steps. 

(i) y+ 3y’ — 4y = 0 

(ii) y — dy!” + 6y"” — 4y' — 15y =0 

(iii) y . aL yl" = 2y! y= 0 

(iv) y” + y' — 3y =0 

(v) is + 3y”—y=0 

You will need to first write the characteristic polynomial in order to find the 
roots, which are not necessarily real-valued. 


Quit|] 

sa Ce ae 

Solve[f [r]==0, r] 

gle) Sere 4 eG r = 4 = 45 
pone le lalas r] 


infe J] = i See er 
hsol = Solve[h[r]==0, r] 
N[hsol] 

Fir] =r°+r- 3 

Fsol = Solve[F[r]==0, r] 
N[Fsol] 

N(Fsol[[1]]] 

Gir ] =r° + 3r? - 1 
Gsol = Solve[G[r]==0, r] 
N[Gsol] 
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N(Gsol[[2]]] 


Mathematica Exercises 

Turn in both the commands that you enter for the exercises below as well as 
the output/figures. These should all be in one document. Please highlight or 
clearly indicate all requested answers. Some of the questions will require you 
to modify the above Mathematica code to answer them. 


1. Enter the commands given in Mathematica Example 1 and submit both 
your input and output. 
2. Enter the commands given in Mathematica Example 2 and submit both 
your input and output. 
3. Enter the commands given in Mathematica Example 3 and submit both 
your input and output. 
4. Enter the commands given in Mathematica Example 4 and submit both 
your input and output. 


5. Enter the commands given in Mathematica Example 5 and submit both 

your input and output. 
6. Determine whether the following functions are linearly independent: 
(a) fi(z) =2+ 52 — 327, fo(x) =2-—a2+4+ 27, f3(x) = —2 — 232 4 1527; 
(b) fi(z) =1+4a +227, fo(x) =3—2 +227, f(x) =5 — 2x — 22”. 

7. Determine whether the following sets of functions are linearly indepen- 
dent: 
(a) {1+2a2—3a?+23,2—2+274+323,-4+2-—27+223, -62+827+923}; 

b) {34+ 4a — 3a? + 23,2 — 227 + 423,-4+ 27 —23,-4-—52 —27 +323}. 

8. Use the Wronskian to determine whether the following sets of functions 

are linearly independent. 

a) {cos x, 3cos ax + sin 2x, sin x} (b) {cosx,3cosx + sina, 4sin x}. 

9. Use the Wronskian to determine whether the following sets of functions 

are linearly independent. 

a) {e*, ze, a} (b) {sin(4x) + cos(4a), cos(4x) — sin(4z)}. 

10. Any number can be written in polar form in the complex plane, re’?. 
Find the r and @ values corresponding to the polar form of the following 
complex numbers. 

(a) 2— 32 (b) 22 (c) -1— 54 (d) 3+2 

11. Any number can be written in polar form in the complex plane, re’?. 
Find the r and @ values corresponding to the polar form of the following 
complex numbers. 

(a) 2+ 32 (b) —3:% (c) —2-—% (d) 3+ 7% 

12. Consider the polynomial p(z) = z? +4z+8. Evaluate it at the following 
values: 

(a) 2=2i (b) z=3-2 (c) z=-14+4 (@) 2=—2 


i133, 


14. 


15. 


16. 


WY, 


18. 


il), 


20. 


ile 


DOR 
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Consider the polynomial p(z) = z? — 1. Evaluate it at the following 
values: 
(a) 4 = 2 (b) z=3— 2% (c) z=-14+4 (@) z=1 
Solve the following systems of equations, where A;, Az may be complex- 
valued numbers. 
e@ (2+i)A, + A2=3 Oh ae 
A; + 3Agi = 0 Ay — Agi = —1 

Solve the following systems of equations, where A,;, Ag may be complex- 
valued numbers. 

A, —-A2=1 Ayi- A2Q=1 
Oe en Oy rae 
For y’ + y' +y = 0 with y(0) = 1,y’(0) = 2, use a stepsize of h = 0.1 
to obtain the solution from the 4th order Runge-Kutta method. Plot the 
solution for 0 < x < 20. Give the numerical value of the solution at 
a = 70, 
For y” + 2y’ + 17y = sin(2x) with y(0) = 0, y'(0) = 0, use a stepsize of 
h = 0.1 to obtain the solution from the 4th order Runge-Kutta method. 
Plot the solution for 0 < x < 20. Give the numerical value of the solution 
ai ge = A), 
For y/” + 4y” + 21y’ + 34y = cos(3x) with y(0) = 1, y/(0) = 0, y”(0) = .5, 
use a stepsize of h = 0.1 to obtain the solution from the 4th order Runge- 
Kutta method. Plot the solution for 0 < x < 20. Give the numerical 
value of the solution at x = 20. 
For y!” + xy" + y = sin(x) with y(0) = 1, y'(0) = —2,y(0) = 1, use a 
stepsize of h = 0.1 to obtain the solution from the 4th order Runge-Kutta 
method. Plot the solution for 0 < x < 20. Give the numerical value of 
the solution at x = 20. 
Find the roots of the characteristic equation of the following homogeneous 
ODEs: (a) y”+y/+y =0 (b) y/” + 8y” + 37y' + 50y = 0 (c) 
y4) — 4y(3) — Qy! + 36y’ — 63y = 0 
Find the roots of the characteristic equation of the following homogeneous 
ODEs: (a) y/” + 2y’ + 17y (b) oy” — y” + lly’ — 5ly = 0 (c) 
Ay(4) — ay") + 13y"” — 4y/ — 9y = 0 
Find the roots of the characteristic equation of the following homogeneous 
ODEs: (a) y’” + 4y” + 21y’ + 34y (b) y) + 3y) + Oy!" + 27y” =0 
(c) 4y© + 12y + 25y/” + 12y"’ + 217 =0 
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Chapter 3 Projects 


Project 3A: Runge-Kutta Order 2 
In Sections 2.5 and 3.4, we considered the fourth-order Runge-Kutta 
method for numerically approximating the solution of 


y' = f(x, y(2)). (3.68) 


Here we derive the simpler second-order formula. For simplicity, let’s 
consider y € R!. Given the solution at y(x), we want to approximate 
the solution at y(a +h). To do so we will need to recall the single- and 
multi-variable Taylor expansions: 


yla+h) = ya) + hy (a) + Sy"(a) + O(n) (8.69) 
flat hy +k) = fay) + neh (ay) + eek t-~. (8.70) 
4 OF 3Y = ZY ap Zx,Y Oy ZY s 0 


(1) Differentiate Equation (3.68) and use the Chain Rule to obtain 


u"(v) = FE (eu) + Lev) sle0). (3.71) 


(2) Use Equation (3.68) and Equation (3.71) to rewrite Equation (3.69) 
as 


yo +h) =y(a) + £f(0,y) (3.72) 
+5 [fle they) +rZL(e,y)s(en)| +008). 


(3) Rewrite the expression in brackets in Equation (3.72), using Equation 
(3.70), to obtain 


h 


ylo+h) = v(x) + f(a) + Silat hy + hf(e.y)) + O(R). (3.73) 


(4) Use Equation (3.73) to obtain the following second-order Runge- 
Kutta method: 


1 1 
Yai =Yth (5 ata she) (3.74) 


with ky = f(a,y),ko = f(c +h,y + hk). (3.75) 
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Project 3B: Stiff Differential Equations 


We studied the equation for a damped, unforced mass on a spring: 
mz” + be’ +kx =0, 


where m,b,k > 0 are constant. There are many situations that arise 
where these constants are not close to each other in magnitude. One 
specific area of interest is when the spring constant k& is large. Such 
systems are said to be stiff. Here we will consider the equation 


a! +2 +1000z =0. (3.76) 


(1) Solve this constant coefficient ODE and write its analytical solution. 
Use the initial condition (0) = 1, x’(0) = 0. 

(2) Using MATLAB, Maple, or Mathematica solve this equation using 
the fourth-order Runge-Kutta method introduced in this chapter. Try 
seven different runs, each with a different step size, using step sizes of 
h = 0.2,0.1,0.05, 0.02, 0.01, 0.005, 0.002 and estimating the solution at 
ta — 72) 

(3) Compare the analytical solution from (1) with the numerical 
approximation from (2). Comment on the accuracy of the numerical 
answers. 

Besides decreasing the step size, stiff differential equations are often 
handled with other methods, typically implicit ones. See Project 2B 
in this book for two methods and numerous others in books such as [10]. 


This page intentionally left blank 


Chapter 4 


Techniques of Nonhomogeneous 
Higher-Order Linear Equations 


In this chapter, we examine how to solve linear equations in which there 
is a forcing function. In Sections 4.2-4.3, we consider two different meth- 
ods for solving linear, constant coefficient ODEs whose forcing functions are 
polynomials, exponentials, sinusoidal, or a combination of these. While the 
reader may read both of these sections, it is our intention that most will 
choose one of these methods for solving this type of equation (and thus skip 
the other section). In Section 4.4, we present an alternative method that is 
much quicker for forcing functions that are exponential or sinusoidal (viewed 
as complex exponentials) and thus might be ideal for engineering students; 
however, forcing functions that are multiplied by polynomials require a bit 
more work and one of the methods of Section 4.2 or 4.3 is needed to addition- 
ally solve an ODE that has polynomial-only forcing in order to complete the 
problem. Since most realistic engineering applications have forcing functions 
that involve decaying exponentials or sinusoidal functions, focusing mainly on 
the exponential or sinusoidal functions in Section 4.4 will likely be sufficient. 
These three sections are in contrast to Variation of Parameters that does not 
require a prescribed type of forcing function nor does the equation need to 
have constant coefficients. Our reason for presenting all four methods is the 
greatly varied audience that is learning from this book, and each method has 
its place. We begin with a little background on nonhomogeneous equations. 


4.1 Nonhomogeneous Equations 


We will now begin discussing the nonhomogeneous equation 


d” 
An (x) — + Gn_1(2) 


d’—ty 
dr”™-1 


dy 
dx 


fF... +a4(2) + ao(x)y = F(x), (4.1) 
originally given at the beginning of Chapter 3. Up to this point we have been 
focusing on the solution of the homogeneous equation 

d"y d’—ly 


An (x) Pe + Gn—1(2) 7 


dy 
dx 


El +... + ay(x) 
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and concentrating on the case in which (4.2) has constant coefficients. We will 
see how our work with homogeneous equations will play a role. In general it is 
not easy to solve this equation; sometimes we can get lucky, while other times 
we may only be able to guess a particular solution. Fortunately, many real 
world phenomena are accurately modeled with sinusoidal forcing functions 
and we will be able to solve these with the methods of this chapter. 

We begin by considering (4.1) written in operator notation: 


P(D)y = F(z), 


where P(D) = a,(x)D" + an_1(x)D"-! +...+ .4;()D + ao(x). We define a 
particular solution, y,, to be any solution of (4.1). This means that 


P(D)Yp = F(x). 


Verify that y, = x? —2z is a particular solution to y”+y! = 22. 


Solution 
We need to substitute this into the differential equation and show that it 
holds. 


2 +2¢%—2= 22, 
ST” 


att / 
Yp Vp 


which clearly holds for all x. Thus yp is a particular solution. 


THEOREM 4.1.1 

Let y, be any particular solution of the nonhomogeneous nth order linear 
differential equation (4.1). Let u be any solution of the corresponding 
homogeneous equation (4.2); then u + yp is also a solution of the given 
nonhomogeneous equation. 


|Example 2| Note that y = x is a solution of the nonhomogeneous equation 


dy 
sa tye 
daz | 4 
and that y = sin is a solution of the corresponding homogeneous equation 
dy 
— +y=0. 
dx? | 4 
Thus, the sum y = x + sin & is a solution to 
d2 
= +y=2. 


dx? ial 
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|Example 3 | Verify that yp = ge~?” is a particular solution to y” + 4y! + 


13y = e 2%. Then use this information to find a particular solution to 
y” + 4y’ + 138y = —4e7?". 


Solution 
Subsituting into the differential equation gives 
—2 1 
9 “Tt 4. ae +13- a =e 
— 
Up a Yp 


Simplification on the left gives e~?” and thus y, is a particular solution. For 
Pp & Yp 


the second part of the question, we rewrite the left side using operator nota- 
tion: P(D)y = e~?*. Since y, is a solution, this means that 


PO)y.=e*. 


From the linearity of the operator (see Section 3.1.1), for any constant c we 
have cP(D)y, = P(D)(cyp). Because the homogeneous part of both equations 
in our current example, P(D)y, is the exact same we can multiply the first 
equation by an appropriate constant so that the right-hand sides match: 


—4-(P(D)y=e**) — sothat = P(D)(—4y) = —4e7?". 
——— 
original ODE 
Thus if yp is a particular solution for the first equation, then 
P(D)yp =e?” => P(D)(—4yp) = —4e-?" 


—22 


and thus —4y, = =e is a particular solution of the second equation. 


The two key items in the previous example are that the operator is linear 
and that the left-hand sides, P(D)y, are the exact same. We have been careful 
in the discussion so far to not refer to the particular solution but rather to a 
particular solution. The reason for this is captured in this next theorem. 


THEOREM 4.1.2 


Let y, and Y be two solutions of the nonhomogeneous equation P(D)y = 
F(x), where P(D) is a linear operator. Then 


VY = Wp ar Ch@ht ap Gad sh ee ab Cada. 


where {y1,--: , Yn} is a fundamental set of solutions for P(D)y = 0. 


In other words, once we have one particular solution, yp, any other particu- 
lar solution, Y, that we may find is just a linear combination of the particular 
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solution we already had plus the solution from the homogeneous equation. 
Thus, we only need to find a particular solution because any other solution 
that we may find is simply a combination of this plus the homogeneous solu- 
tion. 

Proof: Since both are particular solutions, we have P(D)y, = F(a) and 
P(D)Y = F(x). We consider Y — y, and apply the operator P(D) to it: 


P(D)(Y — yp) = P(D)Y — P(D)yp (by linearity) 
= F(x) — F(x) =0, 


from which we conclude that Y — yp solves the homogeneous equation. It 
follows that Y — y, can be written as a linear combination of the solutions in 
the fundamental set, i.e., 


Y = Yp = C1Y1 + CoY2 +++ + Cnn for some constants C1,--- , Cn. 


The conclusion of the theorem follows. 


THEOREM 4.1.3 


Let yp» be a particular solution of the nth order nonhomogeneous linear 
differential equation (4.1). Let 


Ve = Gil 4? GUD sr c6 0 ar Cau 


be the general solution of the corresponding homogeneous equation (4.2). 
Then every solution ¢ of the nth order nonhomogeneous linear differential 
equation (4.1) can be expressed in the form 


P= Yo + Yp- 


The general solution of (4.2), y., is called the complementary function 
of (4.1). (Note that the general solution of (4.2) is sometimes called the 
homogeneous solution and is denoted y;,. Thus both y. and y;, denote the 
same thing.) We can summarize this theorem as 


general solution of nonhomogeneous 
= general solution of homogeneous 


+ particular solution of nonhomogeneous 


Note that we still have not discussed exactly how to find a particular solu- 
tion for a given differential equation—we are simply stating that once we do 
know a particular solution, we can write the general solution to the nonhomo- 
geneous equation. 
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| Example 4 | + Consider the differential equation 


dy 
roe ia 


The complementary function is the general solution 


Yo = C1 SINZ + C2 COSH 


of the homogeneous equation. A particular solution is given by yp = x as 
mentioned in Example 2, so that the general solution of the nonhomogeneous 


equation is 
y=csinex+cgcosx4+ a. 


As mentioned before this example, we will show how to obtain this y, in the 
next section, but for now we pursue further how a particular solution fits into 
the larger theory of solving nonhomogeneous linear differential equations. 


| Example 5 | Consider the differential equation 


y” —4y = sina. 
A particular solution is given by 
—1 


Yp = > Sina. 


5 
We can see that yp is actually a solution since 


Substituting into the original differential equation gives 


1 
Vp dy = = sine 1( - sins) =sinz, 


which shows that y, = = sin x is a particular solution. 


Now it is straightforward to calculate the homogeneous solution 


Yo = ce 2" + cge?*. 


Thus the general solution is 


1 
y(x) = ye(x) + Yp(x) = ce 27 + cpe?* — 5 sin x. 


(4.3) 


Now let’s consider two differential equations with the same operator: 


P(D)y = F(a), P(D)y = F(z). 
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Let us assume we have a particular solution Y, for the first and Y2 for 
the second. Can we say anything about the particular solutions of P(D)y = 
F(x) + Fo(x)? By linearity of the operator, P(D), we know that 
P(D)(%1 + Y2) = P(D)Yi + P(D)¥2 = Fi(z) + F(z). 


In other words, Y; + Y2 is a particular solution of P(D)y = Fy(x) + Fo(z). 


Given that Y, = x is a solution to y” + y =a and Yo = s isa 
solution to y” + y =e”, find a particular solution to y” + y = x + 3e”. 


Solution 
Since $ is a solution to y” + y = e”, it follows that ae is a solution to 


y” +y = 3e*. Thus a particular solution to y” + y = x + 3e” is given by 


e 
ee 
a 


Forced Mass on a Spring 

Perhaps the most studied example of nonhomogeneous equations is that of a 
forced mass on a spring. We again consider the differential equation describing 
the motion of a mass on a spring and will let x(t) denote the displacement: 


m—, +b—+ke = F(t). (4.4) 


We have discussed the case when F(t) = 0 in Section 3.7 and will now consider 
the more general case when F(t) 4 0. The physical interpretation of this type 
of situation is one in which the support of the spring, i.e., the object to which 
the spring is attached, is shaken or forced according to some known function. 
Figure 4.1 gives one manner in which this may be done and Problems 10-12 
in Section 4.7 explore alternative formulations for a forced mass on a spring 
in which the damping is through a dashpot. A typical assumption is that 
the forcing function can be written as 


F(t) = Fysin(wt), (4.5) 


where Fo is the magnitude of the forcing function and w is the frequency of this 
forcing. We note that this w is completely independent of the inherent natural 
frequency, wo = Jt , of the undamped mass-spring system. Many types of 
forced vibrations can be well approximated with such an assumption. This 
is also mathematically convenient because we can “guess” that the form of 
the particular solution should involve sin(wt) and maybe even cos(wt). What 
we really want to understand is how changing the frequency of the forcing 
oscillation, w, can affect the motion of the attached mass. 
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| y=FrO 


k 


lx 


FIGURE 4.1: Mass on a spring forced through spring support. 


| Example 7| Consider a forced mass on a spring governed by the equation 


x" (t) + =a’ (t) + x(t) = sin(2t). (4.6) 


Physically, we have that our mass and spring constant are both one but, more 
importantly, we see that the damping coefficient is small in comparison. Cal- 
culating b? — 4mk shows that our motion is underdamped. How does the 
forcing frequency w = 2 affect things? 


Solution 
We can calculate the complementary solution as 


1 1 
a(t) = cye~*/4 sin (1) + c2e~*/4 cos (42.) (4.7) 


because we again have constant coefficients. A particular solution is given by 


t_(t) = 7 sin(2t) — o cos(2t) (4.8) 


and the reader should check this. Our general solution is then x,(t) + p(t). 


It is very worthwhile at this point to scrutinize these two parts of the 
solution. The solution of the homogeneous equation, x(t), is exactly Case 
3 from Section 3.7 describing the possible motions of a damped spring. We 
know from those results (or could easily calculate if we already forgot) that 


V1 V15 
lim a.(¢) = lim cye*/4 sin (.) + coe */* cos ()) = 0. 
too t-00 4 4 
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(This is another instance where writing the solution in the amplitude-phase 
form makes the evaluation of this limit easy.) As mentioned earlier, we call 
this motion transient because it dies off as t + oo; however, it is not the 
case that x,(t) dies off. Indeed, 


lim z,(t) does not exist 

too 
because the sine and cosine continue to oscillate as t + oo. What does this 
mean? It simply (and importantly!) indicates that the motion of the mass 
does not stop. We can write bounds on the motion of these steady-state 
oscillations, (4.8), using our standard trigonometric identities; see (3.48): 


ov, fay 2 
(a0) + (a5) = sam 
Figure 4.2(a) gives a graph of the solution with the initial condition 7(0) = 
1, 2’(0) =0. 
It may seem completely obvious that by forcing the spring support, we per- 
petuate the motion of the spring. What may seem strange is that, for a given 


mass-spring system, the frequency at which we choose to force the support 
may have a significant effect on the motion of the mass. 


|Example 8 | © Consider the same mass-spring system as in Example 7 but now 


we will use a different forcing frequency: 


a(t) + 520'(t) + (6) = sin (v3 (4.9) 


The homogeneous solution is the same as before and we can check that 


xp(t) = = cos (v3) + = sin (v3) (4.10) 


is a particular solution. The homogeneous (transient) solution again dies off 
and the particular (steady-state) solution determines the long-term behavior. 
We can again write bounds on the motion of these steady-state oscillations, 
(4.10), using our standard trigonometric identities: 


2 
svi4\ (8 7 8 
15 15): ~ 4/15. 
For the same initial condition and mass-spring system, changing the frequency 


of the forcing function dramatically increased the amplitude of the steady- 
state oscillations; see Figure 4.2b. 
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(a) (b) 

FIGURE 4.2: Forced damped motion with m= 1, b= 1/2, k =1 for the 
initial condition 7(0) = 1, 2’(0) = 0. In (a), the forcing function is F(t) = 
sin(2t); see Example 7. In (b), the forcing function is F(t) = sin(,/7/8 t); see 
Example 8. Note the dramatic difference in the amplitude of the steady-state 
oscillations. 


This phenomenon of periodically forcing an oscillating system in a way that 
excites or amplifies the motion is known as resonance. We will discuss reso- 
nance in more detail after we learn how to find particular solutions. But we 
mention two often-used examples. The first is that of a group of marching 
soldiers that will go out-of-step as they walk across a bridge. They do this 
because they don’t want to introduce a periodic forcing that might put their 
own lives in danger! The second was a catastrophic event that actually was 
not due to resonance. In 1940, the Tacoma Narrows bridge collapsed due to 
strong winds that caused the bridge to sway with large oscillations.! Reso- 
nance was originally used to explain its collapse even though it’s clear that 
a bridge naturally has large damping (and a strong effect due to resonance 
requires small damping). It wasn’t until the 1990s that it became better un- 
derstood how nonlinear effects actually caused the collapse of the bridge [28], 
[31]. We will not go into any details of the mathematics but encourage the 
reader to use the numerical techniques of past sections to explore some of this 
research. 


Overview 

Examining the forced mass on a spring has given us sufficient motivation as 
to the importance of the study of nonhomogeneous equations. Our goal in the 
next few sections will be to find ways to obtain a particular solution. The two 


1Try a web search using “Tacoma Narrows bridge” and you should be able to find video 
footage, pictures, and additional information. 
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methods on which we will focus are the method of undetermined coefficients 
and variation of parameters—both are simply ways of accomplishing our goal. 


Method of Undetermined Coefficients (Section 4.2 or 4.3) 

This method will only work when the right-hand side of the equation, i.e., 
the forcing function F(a), has the form of one of the solutions of a linear 
homogeneous equation with constant coefficients and when the left-hand side 
is linear with constant coefficients. For example, we will be able to solve 


yO) + Qy” + Ty = sin(3x) + 2e?* cos(x) + e~?* 


but we will not be able to solve equations such as 
y’+ay=sin(z) or y’+y=tan(z). 


To use this method, we will assume a certain form of the particular solution, 
with coefficients to be found, and we will substitute this assumed form into 
the differential equation and find the coefficients. 

We will initially focus on the mechanics of obtaining the particular solution 
from an assumed form. We will then examine two methods used to obtain 
the “assumed form” of the particular solution. The first will be via super- 
position (or more simply thought of as tables, memorization, or copying the 
form of F’) and the second will be via annihilation. 


Exponential Response and Complex Replacement (Section 4.4) 
This method will work quickest in the case of exponential or sinusoidal forc- 
ing when these terms are not multiplied by a polynomial. In the case of 
sinusoidal forcing, our approach utilizes complex numbers extensively. In 
these situations, we will first rewrite the sinusoidal forcing term as a com- 
plex exponential. We will then divide by an appropriate complex number and 
we then have the complex form of our solution. Depending on our original 
forcing function, F(a), we may have to pull out the real or complex parts 
of this soluion. When the (possibly complex) exponential forcing is multi- 
plied by a polynomial, we will additionally be required to use the Method of 
Undetermined Coefficients to solve a polynomial-only forcing function. Thus 
this particular method works great if only exponential or sinusoidal forcing 
functions are present, which is the situation that occurs in most engineering 
applications. 


Variation of Parameters (Section 4.5) 

This method will work in two places where the method of undetermined co- 
efficients fails—it works when the coefficients are non-constant and for any 
form of forcing function F(x). For example, it will work on all three of the 
examples given above: 


y©) 4+ 2y" + Ty = sin(3x) + xe?” cos(x) + e~ 7%, 
y+ ey =sin(x), and y”+y=tan(z). 
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You may wonder why we should even learn the method of undetermined co- 
efficients, but it turns out that if we have a simple equation such as 


y +y=2 


the method of undetermined coefficients will be far less work than variation 
of parameters. 

The main drawback of the variation of parameters, as we will see, is that 
it requires us to know a fundamental set of solutions before beginning. If our 
equation has constant coefficients, this will not be a problem. But if we have 
a non-constant coefficient equation, we must obtain the solution by whatever 
means necessary. 


Problems 


In Problems 1-8, consider the given differential equation with forcing P(D)y = 
F(x) and corresponding particular solution y,. Find a particular solution for 
the new forcing function F2. 


_3¢% 
1. y” — 5y' — 6y = 3e” with y, = Sa Fo(x) = —5e” 
5) 
2.y” +4y' = 8x —3 with y, = 2? — 12 F(x) = 4a — 3 
—1 7 
Ly’ t+y' — by = sine with yp = 5p cose — 5p sins: Fo(x) = 3sina 
.y” —4y =17 cosa with yp = —4sina — cosa; F2(x%) = —3 cos x 


1 
.y” +9y = cosz with y, = g COS Fo(x) = 12 cosa 


i 


y" +y! = 2x with y, = 2? — 2x; Fo(x) = Az for any constant A 4 0 


TO na pw 


1 . a 5 
ge ¥ — dy’ + by = x with yp = & + ge, and 


xz 


y!’ — Sy! + 6y = e® with yp, = a Fo(x) = 2— 12x + 6e* 


.y” — 5y’ + 6y = 1 with yp = 


8.y” + 4y' + 4y = « with y = — and y” + 4y’ + 4y = e-?” with 
2 

Yp = —— Fo(x) = 8x — 3e72” 

For Problems 9-13, use MATLAB, Maple, or Mathematica to numerically 

solve the differential equation subject to the given forcing frequencies. In all 

cases, use the initial condition of x(0) = 1, x’(0) = 0 and numerically plot the 

solution from t = 0 to t = 30. From your graphs, (i) determine which of the 

three frequencies is the resonant frequency; (ii) approximate the steady-state 

amplitude of the solution. 

9.2” +22’ + 6r =sin(wt), with w =1, 2, 3 

10. x” + 2a’ + 3a = sin(wt), with w = 1, 2, 3 

11. 32” +2’ + 2 =sin(wt), with w = \/1/18, \/5/18, \/1/2 

12. 32" + 2a’ + 4x = sin(wt), with w = /5/9, /7/9, ./10/9 

13. 2” + 22’ + 52 =sin(wt), with w =1, /2, V3 
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4.2 Method of Undetermined Coefficients via Superpo- 
sition 

In this section, we give the first of two approaches for using the method of 
undetermined coefficients. Our overall goal, as mentioned earlier, is to find a 
particular solution given some function F(a). We will discuss how to obtain 
the general form of the particular solution for certain functions F(a). The 
method of undetermined coefficients then takes this general form of the par- 
ticular solution and uses the original differential to determine the coefficients 
of the assumed form of the particular solution. 

We again consider the nonhomogeneous differential equation 


qd” nly dy 
An dx” + An—1 sl Pe oak nk oh: dn 1 00¥ = F(), (4.11) 
which is simply (4.1) with the specification that ao, a1,...,@p, are constants 


and F'(a), the nonhomogeneous term, is a general nonzero function of x. 
Recall that the general solution may be written 


Y=Ve + Up 


where y. is the complementary function, that is, the solution to the corre- 
sponding homogeneous equation; y, is a particular solution. We will now 
consider the first of the two methods that fall under the category of the 
method of undetermined coefficients. 


| Example 1 Consider 


dy 9 dy 

dx? dx 
We seek a particular solution, y,, of this nonhomogeneous equation. The right 
side is the exponential 2e*”. We know that we need to find a function y, that 
will be a solution. That is, when we substitute y, into the left-hand side of 
the equation it should equal the right-hand side. Looking for a function that 
when added to its first and second derivatives gives 2e*” suggests that the 
particular solution should also be an exponential of the form 


3y = 2e*”. 


Up = Ae, 


Here A is a constant, which we call the “undetermined coefficient.” 
Thus 
i) = 4Ae*” and y, = 16Ae** 


which gives 
16Ae* — 2(4Ae**) — 3Ae** = 2e™. 
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This simplifies to 
5Ae** = 2e*” 


which must satisfy the differential equation for all x, thus 
5A=2 


so that A = 2/5. Thus, a particular solution is 


2 4 
Up = ae . 
a] 
| Example 2| Now consider the differential equation 
dy ody 
DE Ba 1d) 3a 
dx? d. _ . 


This is the same equation we just considered, except that the right-hand side 
is now 2e3”. Let’s proceed similarly and consider 


Yp = Ae?*. 
Thus 
= 3a = 3a 
Yp = 3Ae*” and y, = 9Ae**. 
Substitution gives 
9Ae** — 2(3Ae**) — 3Ae** = 2e%* 
which simplifies to 
O=2e". 


But, this last equation does not hold for any real x, so that there is no par- 
ticular solution of the form 
3a 
Yp = Aev*. 
° a 


What went wrong? Consider the reduced equation of the nonhomogeneous 
equation: 


The corresponding characteristic equation 
r? —2r—3=0 


has roots 3 and —1, so that e®” and e~* are linearly independent solutions. 
This is why the method failed; the particular solution 


Yp = Ae?” 
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is already a solution to the homogeneous equation! That is, since Ae*” satis- 
fies the homogeneous equation, it reduces the left side to zero, not 2e*”. 


How do you find a particular solution in this case? 


Recall we showed (in the double root case) that e™* and awe” are linearly 
independent, so we try a solution of the form 


Yp = Ane®*. 


Thus, 
Yp = 3Are** + Ae** and yf = 9Are** + 6Ae** 


so that upon substitution we have 
9Aze*” + 6Ae** — 2(3Are** + Ae®”) — 3Are** = 2e**. 
This simplifies to 
4Ae** = Je”, 


which must be valid for all x, so that 4A = 2, which implies A = 1/2. 
A particular solution is 
1 
Yp = 5re 
We need some terminology to help formalize this method of undetermined 
coefficients. 


Definition 4.2.1 
We shall call a function f a UC function if it is either 
1. A function defined by one of the following: 

i) x”, where n is a nonnegative integer 

ii) e*”, where a is a nonzero constant 

iii) sin(bx + c) and/or cos(ba +c), where 6b and ¢ are constants, b 4 0 
2. A function defined as a finite product of two or more functions of 
these types. 


The method of undetermined coefficients applies when the nonhomogeneous 
function F’ in the differential equation is a finite linear combination of UC 
functions. So you can think of the UC functions as “building blocks” of F’. 

Note here that for a given UC function f, each successive derivative of f is 
either itself a constant multiple of a UC function or else a linear combination 
of UC functions. 

For a UC function f, we will define the UC set of f as the set of functions 
consisting of (i) f itself and (ii) all successive derivatives of f that are linearly 
independent of f. 
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The elements arising from (i) and (ii) above must be nonzero. They may 
be multiplied by arbitrary nonzero constants without changing the essential 
“building blocks” contained in the UC set. Thus a UC set of the form {3,5} 
is equivalent to the UC set {2,1} and we will choose the latter formulation 
for convenience. Table 4.1 gives specific examples of UC functions and their 
corresponding UC sets. 


Table 4.1: Examples of UC Functions and Corresponding UC Set 
UC Function UC Set 
az {i} 
2.27 +3 ae, 
Bele eee. 
4. sin(2z) {sin(22), cos(2a) } 
5. 5cos(2z) {sin(2a), cos(2a)} 
6. sin(2x) — 32 cos(22) {sin(2x), cos(2a)} 
f, Pee treme ere re es |, 
8. 3e°* cos(x — 1) {e® sin(a — 1), e&” cos(a — 1)} 
9. xsin(2a) {x sin(2x), x cos(22), sin(2x), cos(2x) } 
10. xsin(2x) + 3cos(2x) {a sin(2a), a cos(2x), sin(2z), cos(2a)} 
11. #?e°* sin(3z) {x7e°* sin(3x), x7e°” cos(3z), re” sin(3z), 
xe°* cos(3z), e°” sin(32), e°* cos(3x)} 


| Example 3] The function f(x) = 2° is a UC function. Now 
f'(z) =3a7, f’(«)=6a, f(x) =6, and f(x) =0, for all n> 4, 


so the linearly independent UC functions of which successive derivatives of f 
are either constant multiples or linear combinations are those given by 2, 2, 
and 1. Thus the UC set of x? is 


fe" a ae, 1}. 
i 


| Example 4| ©) For the UC function f(x) = sin 22, 


f'(z) =2cos2z, and f(x) = —4sin2z, 


so the UC set of sin 2x is 
{sin 22, cos 227}. 
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Table 4.2 gives the general situation as it summarizes our results concerning 
UC functions. 


Table 4.2: UC Functions and Their Corresponding UC Set 


UC Function UC Set 

il, ale Ter ener ay 
>. (oe {e**} 
3. sin(bx + c) {sin(bx + c), cos(bx + c)} 

or cos(ba + c) 
A, epee fate ge ae et 
5. a” sin(bx + c) {x” sin(bx + c), x” cos(bx + c), 

or x” cos(bar + c) x"—1 sin(bx + c),2"—1 cos(br +c), ..., 

xsin(ba + c),xcos(bx +c), 


sin(ba + c), cos(ba + c)} 


6. e* sin(bx + c) {e%” sin(ba + c), e*” cos(bx + c)} 
or e“” cos(ba + c) 
7. ae sin(bu +c) {axe sin(bx + c), x"e% cos(bx + c), 
or ze" cos(br +c) 2” 1te% sin(bx +c), 2”—1e% cos(br + c), 
., ce sin(bx + c), xe*” cos(bax + c), 
e*” sin(ba + c), e*” cos(ba + c)} 


The Method 


Equipped with the table in Table 4.2, we are able to give an outline of the 
method of undetermined coefficients for finding a particular solution yp, of 
(4.11) for which the nonhomogeneous term F' is a linear combination of UC 
functions. 

There are 5 steps to the method: 


1. For each of the UC functions u1,ug,...,Um of which the nonho- 
mogeneous term Fis a linear combination, form the corresponding 
UC set, that is 

Siig Bp oo a 9 Shza 


2. Suppose that one of the UC sets formed, say S;, is identical to (or 
contained in) another, say S;,. Then omit the set S; from your list. 
3. For the UC sets remaining after step 2, examine the list to see if the 
complementary solution ye is listed, say in Sz. If this is the case, 
multiply each member of this UC set S~ by the lowest positive 
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integer power of x so that the resulting revised set will contain 
no members that are solutions of the corresponding homogeneous 
equation. 


4. In general, there remain (i) certain elements of the original UC 
sets and (ii) revised UC sets. From these UC sets, form a linear 
combination of all the elements of these sets in each of these cat- 
egories. The linear combination is formed with unknown constant 
coefficients. 

5. Determine the unknown coefficients by substituting the linear com- 
bination formed in step 4 into the differential equation and demand- 
ing it identically satisfy the differential equation. 


The first 4 steps above are the easiest and create the correct general form 
of a particular solution. That is, after the first 4 steps of the UC method we 
end up with a linear combination of terms with unknown constant coefficients. 
Step 5 requires us to find these unknown (i.e., undetermined) coefficients so 
that the function will be a solution of the differential equation in question. 


| Example 5 | Solve the differential equation 


—< —2-—" — 3y = 2e” — 10sinz. 


Solution 
The corresponding homogeneous equation is 


Gy  idy 
<5 — 24 — ay =0, 
dx? daz 
which has characteristic equation 
r? —2r—-3=0. 
This equation has roots r = 3 and r = —1. The complementary solution is 


Yo = c1€°* +ene7*. 

The nonhomogeneous term is the linear combination 2e* — 10sinx of the 
UC functions e” and sina. We now apply the method just outlined to first 
obtain the correct general form of the particular solution (steps 1-4) and then 
to find the specific particular solution for this problem. 

1. Form the UC set for each of these; we have 


Si = {e*} 


and 
So = {sin x, cos x}. 
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2. Neither of these are identical or contained in each other, so both are 
retained. 

3. The terms e?” and e~* from the complementary solution are not in S$; and 
Sg, so there are no revisions required. 

4. Form the linear combination 


Yp = Ae* + Bi sine + Bycosx 


from $4 from S5 


as a particular solution. 
5. Find A, B,, and By such that y, is a solution of the differential equation. 
We differentiate to obtain 

Ue = Ae* + B, cosx — Bosinex and uM = Ae* — By sinx — Bocosz. 


Substitution gives 


Ae®* — B, sinx — By cosa — 2(Ae” + By cosx — Bg sinz) 
—3(Ae” + By sina + By cosx) = 2e” — 10sina, 


which simplifies as 


4Ae* + (—4B, + 2Bo) sinx + (—4By — 2B,) cosx = 2e” — 10sin x. 
This equation is true for all x, so that 
-4A=2, -—4B,4+2By. =—-10, and —4B,.—2B, =0. 
The system solves to give 
A= =5, By =-2, and B.=1. 


Thus, a particular solution is 


Yp = al 2sin x + cosa. 
Hence, the general solution is 


x Ls 


Y= Yet yp = cre + e7 5¢ 2sinz + cosz. 
(a) 
| Example 6 | Solve the differential equation 


ig d 
a ee eae Qy = 2x? + e® + Ire” + 4e**. 
dx? dz 
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Solution 
The corresponding homogeneous equation has the characteristic equation 


r? —3r+2=0 


which has roots r = 2 and r = 1. Thus, the corresponding solutions are e?” 
and e”, which gives the complementary solution as 


2 
Yo = c1e” + c2e". 


The nonhomogeneous term is 22? + e* + 27e* + 4e°*, which corresponds to 
the UC functions x?, e”, xe”, and e®”. 
1. For each of these functions, we form the corresponding UC set: 


St = {a" 2, 1}, 
So = to hs 
S3 = {xe*,e"}, 


and 
S4= {e* } : 


2. Note that S2 is completely contained in $3, so that Sz is omitted from 
further consideration. 
3. Further note that 

S3 = {xe”,e”} 


includes e” which is part of the complementary function; thus multiply each 
member of S3 by 2 to obtain the revised set 


Ss = {x7 e, xe”} 
which does not contain solutions of the corresponding homogeneous equation. 


4. From the revised and remaining UC sets, we have the six UC functions 


x7, x, 1, e8%, #%e”, and xe”, from which we form the linear combination 


Aya? + Aga + Ag+ Be?® + Cyax7e” + Coxe”. 
——— ee” Sa e——————~+ -/- -__“_ 
from 5} from S4 from S3 
5. A particular solution is thus of the form 
Yp = Aya? + Agu + Az + Be®® + Cyx?e” + Coxe”. 
In order to find these unknown coefficients, we differentiate y, to obtain 
i = 2A," + Ao + 3Be®” + 2C) xe” + Cx? e” + Coe® + Coxe” 

and 


a = 2A, + 9Be®” + Cyx2e* + AC xe + 2Cye” + Core” + 2C oe”. 
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Substituting for y”, y’ and y gives 


2A, + 9Be® + Cyax7e* + 4Cy xe + 2C ye” + Coxe” + 2Coe* 


— 3(2A;" + Ap + 3Be™ + 2C ne + Cyr e* + Coe” + Coxe”) 
+ 2(Ai2” + Aov + Ag + Be™ + Cyz’e" + Coxe") 


= 2a? + e* + Qre® + 4e**. 
This simplifies as 
(2A; — 3Ag + 2A3) + (2Az — 6A1)2 + 2A) 2? + 2Be%* 
—2C xe” + (2C; = C2)e” 
= 2x? + e” + 2xe* + 4e**. (4.12) 
Comparing coefficients gives 
2A, — 3Ag+2A3=0, 242-6A1 =0, 2A) = 2, 

2B=4, —-2C,=2, 2C,-Cy2=1. (4.13) 
Solving these six equations for the six unknown constants gives Ay = 1, Ag = 


3, A3 = 7/2, B= 2, Cy = —1, and Cy = —3. A particular solution is 


4 
Yp = 2? + 3a + 5 + 2e3" — xe" — 3re* 


and the general solution is 


7 
Y=VYetYp=cie + ee” +e" 430+ 3 +: 262” — 9" 6" — Bae. 
@ 
| Example 7 | Solve the differential equation 


d*y 


d2 
fe + i = 327 + Asin x — 2cosz. 


Solution 
The corresponding homogeneous equation is 


d‘y dy? = 
dx* — dx? 


which has characteristic equation 


This polynomial factors as 
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so that r = 0 is a double root and r = +7. The complementary solution is 
thus 
Yo = C1 + Co% + C3 Sin x + C4 COS 2. 


The nonhomogeneous term is the linear combination 3x? + 4sin x — 2cosx 
of the UC functions «?, sinx, and cos 2. 
1. The UC sets are 
Si = ta", ot, 
So = {sinz, cos x}, 
S3 = {cosz,sina}. 


2. Sp and S3 are identical; we only retain one. Thus, the UC sets are 
Sy = | 7 i}; 
So = {sin x, cos x}. 


3. Notice 
Si = 1a" a. 1} 


contains 1 and x, which are solutions of the corresponding homogeneous dif- 
ferential equation. Thus, we multiply each element by x? to obtain 


St = {a*, 2°, x7}, 


none of which are solutions. Similarly, sina and cosa are solutions of the 
corresponding homogeneous differential equation. Thus, we multiply each by 
an x, so that 

Si = {xsin x, x cos x}. 


4. We form the linear combination of these five UC functions, i.e., 


A,x* + Agu? + Agu? + Byxsing + Boxrcosa, 
a ee NG ee, 


from 4 from S5 


where Aj, Ag, A3, By, and Bz are undetermined. 
5. Substitute the particular solution 


= Aya* + Aor? 4 Asx? + Byxsina + Box cosx 
Up 


into the differential equation in order to determine the unknown coefficients. 
Differentiating gives 


Vp = 4A,2° + 3Anx? + 2A3x + Byx cosa + By, sinx — Box sinx + Bo cos Hie 


Yp = 12A,27 + 6Agx + 243 — Byxsinx + 2B, cosx — Box cosx — 2B, sinz, 


vi 


Yp = 24A\x2+6A2 — Byxcosx — 3B, sinx + Box sinx — 3B cos 2, 


and 
yh) = 24A, + Bixsinz —4B,cosx+ Boxcosx +4B2sinz. 
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Substitution gives 
24A, + Byxsinz — 4B, cosx + Boxcosx + 4Bo sinx 


+ 12A,2? + 6Aox + 2A3 — Byxsinxg + 2B, cosa — Box cosa — 2B sina 


= 3x7 + dsinae — 2cosz. 
Equating coefficients gives 


94A, +2A;=0, GA, =0, 124, =3, 


—2B, = —2, and 2B, = 4. (4.14) 
Solving this system of equations gives 
1 
Al=7) Az = 0, A3 = —3, B, =1, Bg = 2, 


so that a particular solution is 


1 
Up = ie 3a? + sina + 2x cosa. 


This gives the general solution 


. 1 ; 
y =, + cou + es sine + cy cose + 52" 3x7 + xsinaz + 2rcosz. 
& 


It may often be easier to do steps 4 and 5 in the above method with the help 
of our computer programs and examples are seen at the end of the chapter. 
e e e e e e e e e e e e 
Problems 


In Problems 1-8, write the form of the particular solution but do not solve 
the differential equation. Make sure to solve for y- first! 


Ly’ +y=e*+2? 2. y” + 3y' = xe?” + cosx 
3.y”" +y =4sinaz + e* cosa 4. y" + 4y' +y =sin(2x) + cosa 
5. y!" +y = xe?* cosxr +sine 6.4" —y=e*+2e* 

7. y'" + 8y =4sine + cosx 8. yO +y" = 23 + xe cosz 


In Problems 9-15, use the method of undetermined coefficients (step 5 only) 
to find the coefficients of the particular solution for the given equations. 

9. y" + 4y' + 13y =e72", yp = Ae” 

10. y” + 4y' = 2?—3, y = Av? + Br? +Cxr 

11. y” —4y' =cosx+3sinz, yp = Acosx+ Bsing 

12. 9y” +y =cosz+sin(2z), y, = Acosx+ Bsing + Ccos(2x) + Esin(2z) 
13. 4y"” + 25y = acosz, yp, = Acosx+ Bsing + Cacosz+ Exsing 

14. y” + 2y!+17y =e" +2, yp = Ae? +B 

15. y” + 3y’ — 10y = we? + 2a, yp = Ae? + Bue*+Ca+E 
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For Problems 16-28, find the general solution of the given differential equa- 


tions. 

16. y" + y' — by = 2x 17. y” — 2y! — 8y = 4e?* — 21e-%* 
18. 4y” — 4y’ — 3y = cos 2x 19. y” — 2y! + 2y = xcosa 

20. y” — 16y = 2e*” 21. y” — 2y' + 5y = e* sin 2x 

22. 4y” + 4y'’ + y = 32e" 23. y” — 2y' + 5y = 2xve* + e* sin 2x 
24. y+ y' =2—sine 25. y” + 4y' + 3y = cosha 

26. y"” + 2y' + y = 2e-* 27. y'" + 10y” + 34y! + 40y = re-* 
28. y — 18y" + 81y = e%* 


For Problems 29-34, find the general solution of the given differential equa- 
tions. Then find the solution that passes through the given initial condition. 


29. 
30. 
31. 
32. 
33. 
34. 
35. 


36. 


y” — 4y = 322, y(0) = 0,y'(0) =6 

y" +y=cosz, y(0) =1, y'(0)=—-1 

y" — 8y' + 2y =e”, y(0) =1,y/(0) =0 

y" + 4y = x? + 3e7, y(0) = 0,y'(0) = 2 

y” + by’ + 10y = 3x2e7—3* — dede cos x, y(0) = 1, y’(0) = —2 

y” — 2y' — 38y = 3xe?”, y(0) = 1, y/(0) =0 

The method of undetermined coefficients can be used to solve first-order 
constant coefficient nonhomogeneous equations. Use this method to solve 
the following problems: 

(a) y' — 4y = 2? 

(b) y’ +y = cos 2x 

(c) y’ -—y=e* 


Suppose that yi (a) and y2(x) are solutions of 
Py | dy 
— — = 
aT + ae +cy = f(a), 


where a,b, and c are positive constants. 
(a) Show that 


lim [yo(x) — yi(z)] = 0. 


Loo 


(b) Is the result of (a) true if b = 0? 
(c) Suppose that f(x) = k, where k is a constant. Show that 


k 
lim y(x) = — 
c 


woo 


for every solution y(a) of — + nu +cy=k. 


dx? dx 
; d’y _,dy sae 
(d) Determine the solution y(a) of as + - =k. Find lim y(2). 
woo 
dy 
(e) Determine the solution y(x) of a =k. Find lim y(a). 
dx? 200 
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37. (a) Let f(x) be a polynomial of degree n. Show that, if b # 0, there 
is always a solution that is a polynomial of degree n for the equation 
y” + ay’ + by = f(z). 
(b) Find a particular solution of y” + 3y’ + 2y = 9 + 2x — 227. 


38. In many physical applications, the nonhomogeneous term F(x) is speci- 
fied by different formulas in different intervals of x. 
(a) Find a general solution of the equation 


Note that the solution is not differentiable at x = 1. 
(b) Find a particular solution of 


that satisfies the initial conditions y(0) = 0 and y’(0) = 1. 


4.3. Method of Undetermined Coefficients via Annihila- 
tion 


We saw in the previous section how to obtain the particular solution by first 
assuming the correct general form (based on F'(x)) and then substituting into 
the differential equation to obtain the specific particular solution that satisfies 
the equation. Here, we present an alternative method to obtaining the correct 
general form based on F(x). The operator notation gives us a useful idea, as 
can be seen in the following example. 


|Example 1, Consider the nonhomogeneous constant coefficient differential 


equation 
dy _ 
ae y=", 
which can be written as 
(D? —l)y=a (4.15) 


using operator notation. The general solution to this nonhomogeneous equa- 
tion, y = Ye + Yp, must satisfy this equation upon substitution into it. If 
we differentiate the given equation twice, we obtain the fourth-order linear 
homogeneous equation with constant coefficients 


an (4.16) 
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which can also be written as 
D?(D? — Dy = Dz = 0. (4.17) 


The general solution to (4.15) must also satisfy the differential equation (4.17). 
We note that (4.17), or equivalently, (4.16), is homogeneous with constant 
coefficients. This equation has the characteristic polynomial 


which can be further factored as 
r(r +1)(r —1) = 0. 
Thus the general solution of (4.17) must be of the form 
y(x) = Ay + Agx + cye~* + eye” 


for constants A;,A2,c1,¢c2. Substituting this form of the solution into the 
original equation gives 


(cye_* + cge”) — (cre ” + c9e” +ky + kon) =a 


so that 
A, =O and Ap =—-1 
by comparing coefficients. Thus, 
y(a) = —@+ce* + ce”. 
a 


This example motivates the idea of an annihilator. Notice we were able to 
obtain a homogeneous equation by “annihilating” the nonhomogeneous term x. 


Definition 4.3.1 


The linear differential operator Q(D) annihilates a function y(a) if 


Q(D)y(x) = 0 


for all x. In this case, Q(D) is called an annihilator of y(z). 


| Example 2 | The linear differential operator Q;(D) = D® annihilates the 


function y(x) = x? because Dx? = 0. Similarly, the linear differential opera- 
tor Q2(D) = D — 2 annihilates the function y(x) = e?* as 


Q2(D)(e?”) = De2® = Qe? —0. 
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| Example 3 | Using the functions of the previous example, we can also ob- 


serve that 


Q1(D)Qs(D)(a? + &") = D7(D = 2)(2" + e?*) = 0. 
a 


This property holds in general. That is, if Qi(D) and Q2(D) are linear 
differential operators having constant coefficients with Q; annihilating y; (2) 
and Q» annihilating y2(a), then Q1Qz2 annihilates c,y; (a) + coy2(a), where c, 
and cz are constants. This is easy to see, as 


Q1Q2(cryi (x) + caye(2)) = Q1Qa(cim(z)) + Q1Q2(c2ya(z)) 
€1Q1Q2(yi(@)) + c2Q1Q2(y2(x)) 
= €1Q2Q1(y1(a)) + €2Q1Q2(ya(@)) 
= ¢1Q2(0) + c2Q1 (0) 

= 0. 


It is important to note that Q2Q) also annihilates c,y (x) + coye(x) because 
the operator notation is commutative (in the constant coefficient case); see 
(3.8). 

Annihilators of Familiar Functions 

It will be useful for us to know annihilators for our familiar functions. The 
differential equation 


dy 
dx” 
in operator form is 
D"y =0, 
and has solution 
y= +egr4 e307 +... + Cpa". 


Thus, D” annihilates the functions 


as well as any linear combination of these functions. This result means that 
any nth degree polynomial in x will be annihilated by an (n+ 1)st differential 
operator. 

A general solution of the differential equation 


(D—r)"y=0 
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is 
Per 4 te, yar ter 


since we see that r is a root of the characteristic equation and the root occurs 
n times. Thus, the differential operator (D — 1)” annihilates the functions 


y=ce” + cone” + c3% 


ene, 8, 5.98 


m1 ore 
We show this for the case n = 2: 
(D—r)? (cye™ + core”) 


= (D—r)?(c1e"") + (D —r)?(coxe™) 


=0. (4.18) 


If the characteristic equation of a differential equation has complex roots 


r2=ath 
with b £0, we can write the characteristic equation as 
(r — (a+ bi))(r — (a— bt) = r? — 2ar + (a? +b”) =0 
which corresponds to the differential equation 
y” — 2ay’ + (a? + b*)y = [D? — 2aD + (a? + b*)|y = 0. 
Thus, the differential operator 
D? — 2aD + (a? +b”) 


annihilates the functions e*” cos bx and e®” sin bx. 
If the complex roots are repeated with multiplicity n, they correspond to 
the characteristic equation 


((r — (a+ bt))(r — (a — b1)))" = (r? — Qar + (a? + B7))” =0, 


but this corresponds to an order 2n differential equation, which in operator 
form is 


(D? — 2aD + (a? + 67))"y = 0. 
Thus, the differential operator 
(D? — 2aD + (a? + b?))” 
annihilates the functions 


n—l1.ax n—1,ax 


e** cos bx, e™ sin ba, xe“ cos ba, xe“ sin ba,... cos bx, x sin ba. 


These results are summarized in Table 4.3. 
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Table 4.3: Annihilators of Familiar Functions 


Function Annihilator 
ie iDye 
CET, Cla eal (D—r)” 


e*” cos br, xe” cos bx,...2"—1e%* cosbx | (D* — 2aD + (a? + b?))” 


e% sin ba, ze sin bz,...2"—e% sinba | (D? — 2aD + (a? + b*))” 


With the ideas of annihilators in place, we return to the problem of solving 
nonhomogeneous equations with constant coefficients. If the nth-order linear 
nonhomogeneous equation with constant coefficients can be written as 


P(D)y = F(a) 


where F'(a) is one of the functions (or combinations of functions) listed in 
Table 4.3, then we can find another differential operator Q(D) that annihilates 
F(a). 

If the differential operator Q(D) annihilates F(x), applying Q(D) to the 
nonhomogeneous equation gives 


which is a homogeneous equation. 
Let’s see how to apply these ideas. 


|Example 4| Solve the nonhomogeneous equation 


y +y=2". 


Solution 
If we write this equation in operator notation we have 


(D? + 1)y = 2. 


Now the annihilator of x? is D?. We thus can rewrite our original equation as 
the homogeneous equation 


D°(D? + 1)y = 0, 
which has characteristic equation 
r(r? +1) =0. 


This gives the eigenvalues 0,0, 0,7, —7 so that the solution to the homogeneous 
equation is 
y(a) = Ay + Agr + A3x” + By sinx + By cosa. (4.19) 


from r = 0,0,0 from 7 = +i 
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Now if we solve the corresponding homogeneous equation 
y +y¥=0 


we have : 
ye(x) = cy sina + c2 cosa. 


Eliminating these terms from solution (4.19) indicates the particular solu- 
tion has the form 
Yp(Z) => Aj + Aor + Asx”. 


Notice that we would have obtained the same form for y, if we used Steps 
1-4 from the method introduced in the previous section. The name “method 
of undetermined coefficients” really applies to the methods once the correct 
general form of y, has been assumed. At this point, we thus proceed with Step 
5 as before; see Section 4.1. In order to use the original differential equation, 
we will need to obtain the second derivative to yp, in order to substitute. 
Calculating the derivatives gives 


Yp = Ag+2Aga and y, = 2A3. 
Substitution gives 
Up + Yp = 2A3 + Ai + Age + Aza”. 
We know that y/! + yp = 2? and thus 
a? = 2A3 + A, + Aor + Azz”. 
Equating coefficients of like terms gives 
A, = —2, Ag =0 and A3 = 1. 
Thus a particular solution is 
Yp(2) = x" — 2, 
and the general solution to the nonhomogeneous equation is 


y(x) = ye(x) + Yp(xz) = cr sina + cgcosz + 2? — 2. 
ml 


|Example 5 | Solve the nonhomogeneous equation 


Uh 


y +y' =cosx4+a. 


Solution 
We first will find the annihilator of the nonhomogeneous term cos “+a. Since 
D? +1 annihilates cosz and D? annihilates x, the annihilator of cosx + @ is 


Q(D) = D?(D? +1). 
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If we apply this annihilator to both sides of the nonhomogeneous equation, 
we have 
D?(D? +1)(D? + D)y = D?(D? +1)(cosx + 2). 


The right-hand side is thus zero and our equation simplifies to the homoge- 
neous equation 
D?(D? + 1)(D? + D)y = 0. 


The corresponding characteristic equation is 
r(r?+1)(r? +r) =0, 


which can be factored as 
ri(r? +1)? =0. 
The eigenvalues are thus 
0, 0,0, —i, —i, i,4 
so that the solution of this homogeneous equation is 


y(x) = Ay + Aga + Aza? + By cosx + Bosinz + B3xcosx+ Byxsin«. 
——————$— ——E—EEEEE————E—E————————— 


from r = 0,0,0 from r = +7, ti 


As we want to assume the simplest form for the particular solution that 
will satisfy the nonhomogeneous equation, we ignore any factors that also 
occur in the homogeneous equation. Solving the corresponding homogeneous 
equation y'” + y’ = 0, we find the characteristic polynomial is r(r? + 1) and 
the complementary solution is thus 


Ye(x) = cy + C2 cosa + c3 Sinz. 


Comparing y(x) and y-(a) we determine that the particular solution must be 
of the form 

Yp(x) = Aor + Aza” + Bzxcosx + Bax sina. 
This is again the same form we could have obtained with Steps 1—4 of Section 
4.1. We again use the original nonhomogeneous equation to determine the 
constants Ay, A3, B3, and By. Differentiating y, three times and substituting 
into the left-hand side of the nonhomogeneous equation gives 


Yp +Y, = —3B3 cosz + Bgrsinz — 3Bysinx — Byxcosx 


+A + 2A32+ B3 cosx — B3xsinx + Bysine + Byxcosx 


= —2B3cosx —2Bysinz + 2A3x7 + Ag. 


This must equal the right-hand side of the nonhomogeneous equation and so 
we have 
—2B3cosx —2Byzsinxg + 2A3% + Ag =cosx4 a. 
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Comparing coefficients gives 


1 1 
Ao = 0, A3 = -, Bs =-—-, and By = 0. 
2 2 
This gives the particular solution of the nonhomogeneous equation as 
1 1 
Yp(x) = a — gt cose. 


Thus, the general solution of the nonhomogeneous equation is 


1 1 
y(x) = cy + cg cosa + c3 sina 4 5e 5 COse. 


PVN Solve y"+2y!—3y = 4e*—sin x with the conditions that y(0) =0 
and y’(0) = 1. 


Solution 

We first note that this problem differs from previous ones because of the 
presence of initial conditions, but these do not come into the problem until 
the last step. Proceeding as in previous problems, since D — 1 annihilates 
e” and D? + 1 annihilates sinz, the nonhomogeneous term 4e” — sinz is 
annihilated by Q(D) = (D —1)(D? +1). Thus if we apply this annihilator to 
both sides of the differential equation we have 


(D — 1)(D? +1)(D? + 2D — 3)y = (D — 1)(D? + 1)(4e” — sinz) 


and our problem becomes that of solving the homogeneous equation 
(D —1)?(D? +1)(D+3)y =0. 
The corresponding characteristic equation is 
(r —1)°(r? + )(r +3) =0 


which has roots —3,1,1,—7,7. The solution is then 


= Ae %*= 4+ Bye™ + Bore? +C C2 sinz. 4.20 
y(z) e€ 1e 2re 1 cosz + Cp sin x ( ) 
fromr=-—3 from r=1,1 from r = +i 


The solution to the corresponding homogeneous equation y” + 2y’ — 3y = 0 
with characteristic equation r? + 2r — 3 = (r +3)(r —1) =0is 


ye(x) = ce” + ce". 


We eliminate these terms from (4.20) to obtain the form for the particular 
solution as 
Yp(x) = Boxe* + Ci cosx+ Co sing. 
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Differentiating y,(x) gives 


Yp(x) = Boe* + Bore” — Cy sinx + Co cosx 
Yp (x) = 2Bye” + Bore” — C, cosx — Cosinz. 


Substitution of these three equations into the original nonhomogeneous equa- 
tion gives 


A Bye” + (2C2 — 4C,) cosa + (—4C2 — 2C,) sina = 4e” — sing, 


so that 
4Bo = 4, 2C> = AC, = 0, and — AC = 2C, =-—-1. 


Thus, Bp = 1,C, = a and Cy = + and the particular solution y, is 


(x) 5 = pbc IO sta 
x) = xe —cosx+—sinz. 
“ 10 5 
This gives the general solution as 
—3n x x 1 1 . 
y(z) = ce + cge” + xe Tigo | gee 


We now apply the initial conditions to determine the constants c; and co. 


Since 


1 6 
0 = y(0) =e +e + 75 and 1 = y/(0) = c2 — 3c + & 


we can solve the two equations simultaneously to obtain 


1 1 
— 1 and co = =e 


Thus the solution to the initial-value problem is 


Summary of the Annihilator Method 


We can summarize the steps of the annihilator method of solving the nth- 
order linear nonhomogeneous equation with constant coefficients 


as follows: 
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1. Determine an annihilator of F(x). That is, find Q(D) such that 
Q(D) F(x) = 0. 


2. Apply the annihilator to both sides of the nonhomogeneous differential 
equation 
Q(D)P(D)y = Q(D) F(z) = 0. 


3. Solve the homogeneous equation 
Q(D)P(D)y = 0. 
4. Find the corresponding solution y,.(x) to the homogeneous equation 
[Eye = 


which corresponds to the original nonhomogeneous equation. 

5. Eliminate the terms of the homogeneous equation y,.(x) from the 
general solution obtained in Step 3. The expression that remains is the 
correct form of a particular solution. 

6. Solve for the unknown coefficients in the particular solution y,(x) by 
substituting it into the original nonhomogeneous equation 


7. A general solution of the nonhomogeneous equation is 


y(x) = ye(x) + Yp(2). 


Problems 


In Problems 1-8, use the annihilator method to write the form of the partic- 
ular solution but do not solve the differential equation. You will need to do 
Steps 1-5 of the summary. 

Ly" +ty=e% +2? 2. 
3.y”+y =4sing + e* cosa A. 
5.y” +y = xe** cosx + sine 6. 
7.y'" + 8y =4sinax + cosa 8. 


+ 3y’ = x7e?” + cosx 


t dy’ + y = sin(2a) + cosa 


zx 


1 
/ 
/ 


eee 


—y=er+x2e7 
y) + y"” = 23 + xe* cos x 


In Problems 9-15, use the method of undetermined coefficients (only Step 6 
of the summary) to find the coefficients of the particular solution for the given 
equations. 

9. y” + 4y' + 13y =e72", yp = Ae~** 

10. y” +. 4y' = 27-3, y = Av? + Br? +Cxr 


274. Chapter 4. Techniques of Nonhomogeneous Linear Equations 


11. y” —4y' =cosx+3sinz, yp = Aicosx+ Agsina 

12. 9y”+y = cosz+sin(2z), yp = Ai cos#+ Ape sin z+B, cos(2x)+ By sin(2x) 
13. 4y"” + 25y =acosz, yp = Aicosx + Agsinag + Agxcosx + Agr sin x 
14.4" + 2y' + l7y =e" +2, y, = Ae? +B 

15. y” + 3y’ — 10y = we™ + 22, yp = Are” + Aoxe” + Bix + By 


For Problems 16-28, find the general solution of the given differential equa- 
tions using the method of undetermined coefficients. 


16. y" + y' — 6y = 2x 17. y” — 2y’ — 8y = 4e7* — 21e-%* 
18. 4y” — 4y! — 3y = cos 2x 19. y” — 2y' + 2y = xcosax 

20. y” — 16y = 2e** 21. y” — 2y' + 5y = e* sin 2x 

22. 4y” + 4y’ + y = 32e" 23. y” — 2y' + 5y = 2xe” + e* sin 2x 
24. y/" +y' =2-—sine 25. y” + 4y’ + 3y = cosha 

26. y” + 2y’ + y = 2e7* 27. y!” + 10y" + 34y’ + 40y = re-* 


28. y) — 18y” + 8ly = e3* 


For Problems 29-34, find the general solution of the given differential equa- 
tions. Then find the solution that passes through the given initial condition. 
29. y” — 4y = 322, y(0) = 0,y'(0) =6 

30. y+ y=cosz, y(0) =1, y/(0) =-1 
31. y” — 3y’ + 2y =e", y(0) = 1,y'(0) =0 
32. y” + 4y = 2? + 3e”, y(0) =0,y/(0) =2 
33. y” + 6y’ + 10y = 3ae~3” — 2€3” cos x, y(0) = 1, y’(0) = —2 
34, y” — 2y' — 3y = 3ze7", y(0) =1, y'(0) =0 


35. The annihilator method can be used to solve first-order constant coeffi- 
cient nonhomogeneous equations. Use this method to solve the following 
problems: 

(a) y! —4y = 2? 
(b) y' + y = cos 2a: 
(c) y' -—y= eft 


36. Suppose that yi(x) and y2(x) are solutions of 


ao 
Ty dy 


Fig dz + cy = f(x ); 


where a,b, and c are positive constants. 
(a) Show that 


lim [yo(a) — y1(@)| = 0. 


«roo 


(b) Is the result of (a) true if b = 0? 
(c) Suppose that f(x) = k, where k is a constant. Show that 


lim y(a) = — 


x=—-0o 
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d 
for every solution y(a) of act + oF +cy = 
Py | dy 
(d) Determine the solution y(a) of ir + a =k. Find Jim y(2). 
dy aa 
(e) Determine the solution y(x) of a7 = k. Find Jim, y(a). 


37. (a) Let f(a) be a polynomial of degree n. Show that, if b 4 0, there 
is always a solution that is a polynomial of degree n for the equation 
y" + ay! + by = f(a). 
(b) Find a particular solution of y” + 3y/ + 2y = 9+ 2x — 227. 


38. In many physical applications, the nonhomogeneous term F'(2) is speci- 
fied by different formulas in different intervals of x. 
(a) Find a general solution of the equation 


" = x,0<a2<l, 
2 we 


Note that the solution is not differentiable at 7 = 1. 
(b) Find a particular solution of 


” = v,0<a<l, 
y tu-{P lee 


that satisfies the initial conditions y(0) = 0 and y’(0) = 1. 


4.4 Exponential Response and Complex Replacement 


This is the third method we will consider for finding a particular solution 
when the forcing function, F'(«), is a polynomial, sinusoidal, exponential, or 
a product or combination of the three. The method is elegant and very quick 
when the forcing function is an exponential and will require an additional 
method (e.g., undetermined coefficients for a polynomial-only forcing func- 
tion) if either is multiplied by a polynomial. It utilizes the operator notation 
together with complex variables. We begin with our general nonhomogeneous 
with constant coefficients equation 


P(D)y = F(a), (4.21) 


where P(D) = a, D" +an_1D"~-!4+...+a1D+ao. From Section 3.1.1 and 3.6, 
we know that D*e"™® = r*e"® for any k = 0,1,--- . Thus, our linear differential 
operator, P(D), satisfies 


P(D)e™ = P(rje"™, (4.22) 
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where P(r) is the characteristic polynomial. 
If we consider (4.21) with F(a) = ae", then rearranging (4.22) gives 


- P(D)e"™ = ae™. (4.23) 


However, two key elements we learned in Section 4.1 were that (i) we always 
look for @ particular solution and (ii) for a linear P(D) we can pull constants 
through it. Thus (4.23) can be rewritten as 


P(D) (s5°") =ae"™. (4.24) 


Since the ODE we are currently considering is P(D)y = ae”, we can conclude 
that 


ee (4.25) 


is a particular solution, provided P(r) 4 0. Since we just want to find any 
particular solution, we are finished (at least for this simple F'(a)). P(r) = 0 
will be a problem we will need to address but that will come later in this 
section. 


| Example 1, Find a particular solution for 


y’ + 5y’ + 10y = 3e-2”. 


Solution 
Our operator is P(D) = D?+5D+10 so that P(r) = r?+5r+10. A particular 
solution is given for this forcing function by (4.25): 


This is a very efficient way to get a particular solution but it will only work 
quickly for forcing functions that are exponential as in our previous example. 
For most engineering applications, a system is forced with a sinusoidal term 
(via some type of motor) and the present method will again work because we 
know that sines and cosines can be written as the real and imaginary part of 
a complex exponential. The only extra amount of work will be to first rewrite 
the cosine or sine as the real or complex part of a complex exponential and 
then, after using the above method, keep only the part that is needed. This 
will work because the real and imaginary parts do not affect each other; see 
Section 3.5 for more discussion. Let’s consider an example. 
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| Example 2 | Find a particular solution for 


y + 3y' + Ty = 4sin 2a. 

Solution 
Our first task is to rewrite F(a) = 2sina as the imaginary part of a complex 
exponential. Euler’s formula states e’” = cosx +isinx so that 

Asin 2x = Im(4e"””). (4.26) 
Thus, we consider the complex version of our differential equation: 

24.32 +72 =4e*, 
where we have changed our variable from the real-valued y to the complex- 


valued z. A careful look back at our derivation of (4.25) should convince us 
that everything holds for the case of a complex variable. In other words, 


P(D)z =ae"™ Zp ert (4.27) 


is a particular solution. Then, in our current example, a particular solution 
is given by 
—_—-s Aei2a Aei2z 
> PQi) ~ i243) +7 —44+6i47 
ers Ae 3 — bi (12 — 24%)e%* 


z 


~ 346i 346i 3-6i 9436 
_ (12 — 24%) (cos 2x + isin 2x) 
a 45 
12cos274+ 24sin2z  (12sin2x7 — 24cos2x 
= z +i E (4.28) 


Since we began with only the imaginary part in (4.26), we keep the imaginary 
part of Zp: 


Yp 


12cos2%+24sin2x (12sin2x — 24cos 2x 
Im(zp) = Im 5 +4 & 


1 
= (2 cos 2” + 24 sin 2x). 
3] 
Obviously, material from Section 3.5 will come in useful here. We present 
a few different situations of how to complexify a forcing function that is sinu- 
soidal or a sum of sinusoidal functions and then address the situation of when 
they are multiplied by polynomials. 
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| Example 3 | Rewrite 


2cosx+3sin x 


as a complex exponential. 


Solution 

If we had either term separately or if the coefficients were the same we could 
proceed as in Example 2. However, we instead rewrite this with a trigono- 
metric identity as we did in Section 3.7: 


c, cos(wt) + cp sin(wt) = Acos(wt — ¢), 


where A = \/cj + c5 and tang = 2. Thus we have 


C1 


2cosx+3sinz = V13 cos(a — ¢), where ¢ = tan! (5) 


from which it follows that 


2cosa + 3sina = V13cos(a — ¢) = Re (vise ) : 
i 
In the case when we have different arguments of the sinusoidal terms, e.g., 
3cosx+sin 2x7, we remember one of our theorems from Section 4.1 that stated 
that if Y; is a particular solution to P(D)y = F\(a#) and Y2 is a partic- 
ular solution to P(D)y = F(a), then Y; + Yo is a particular solution to 
P(D)y = F\(a) + Fo(x). Thus we can find a particular solution by the meth- 
ods we have learned in this section. If we multiply a sinusoidal term by an 
exponential we can again proceed as we have thus far. 


| Example 4 Find a particular solution to 


y+ 2y' + 4y = e~* cos 3a. 


Solution 
In order to use the methods of this section, we first rewrite the forcing function 
as e~* cos 3x = Re(e*‘—!+%")) and then complexify the equation as 


gl 422! + 4z = et(-1430), 


We can find a particular solution as we did before: 


1 ; e@(-14+3i) 
y= a(—1+3i%) = 
PP’ P(-14+34) (—1 +31)? + 2(-1+ 31) +4 
7 e2(-143i) 7 e2(-143i) 
~ 1-9-61-24+61+4 °° -6 
—e *cos3x —e *sin 3x 
= a) 4,2 
; ——, (4.29) 
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so that 


—e *cos3x 
Yp = Re(z) ===" 


is a particular solution. = 


We have two other situations to consider. The first is when our operator 
P(r) =0 because we would be dividing by zero. The second is when F'(2:) is 
a polynomial of degree 1 or higher (degree 0, i.e., constants can be treated as 
e”). When P(r) = 0, this says that the r from the e” or e’™® forcing func- 
tion (either real or complexified) is also a root of the characteristic equation. 
Thus, our method from this section is not going to give a linearly independent 
solution. In order to obtain a linearly independent solution in the case when r 
has multiplicity one in P(r) = 0, we consider xe" as a possibility and observe 
what results when we apply our operator, P(D): 


D(ze™) = (1+ra)e™, D?(xe"™) =r(2+ra)e™, 
, D*(xe"®) = r*"(k + ra)e™, (4.30) 


so that 
P(D)(xe"™) = (ag9D" + a, D" "+... + Gn—1D + an) (ze"”) 


= [agr® 1(n+ra)+...+an-1(1+rz) + anzje™ 


rx 


= [agr™ a+ ar™ 7m — 1) +... + @a_ile 


+[agr™ tra + ayr™ ra +... + an_irt + anzle™ 


a [agr”*n + ar” 7(n —1)4+...+an-1]e™ 
SS ES eee 
P'(r) 


+lagr™ + ayr”—* +... + an-ir + a, |ne" 
eee SS eee 
Po 


=P (rie. (4.31) 
Thus if we consider P(D)y = ae™ with P(r) = 0, we have 


P(D)(ae") = P’(r)e"®= => P(D) (Fa) = ae™, (4.32) 


TL 
which tells us that Pie) is a particular solution of P(D)y = ae’ when r is a 
Hf 
root of multiplicity one in P(r) = 0. By a similar argument and calculation, 
we can find that particular solutions of P(D)y = ae” for repeated roots r of 
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P(r) =0 are 
ax?er® , % 
pag ER Se eee (4.33) 
_ axe" for P p! pl" 0. Pp” 0 4.34 
Yp = P"(r) or (r) (r) (r) , (r) # ; ( . ) 
ark er® 2 
Yp = PO)( for P(r) a pk Y(r) — 0, P(r) # 0. (4.35) 


| Example 5 Find a particular solution of 


yl" _ 6y"" ae 9y' = 4e?™. 


Solution 

We can easily see that the characteristic equation factors as r(r — 3)? = 0 so 
that r = 3 from the forcing function 4e*” is a root that already occurs twice 
in P(r) = 0. From our previous discussion, (4.33) tells us that a particular 
solution is given by 


4a? 3” Aa? 3” 2 5 3 
Yp = P(3) ue 


~ 63)=12 3 


If our forcing function P(r) had repeated roots due to sines and cosines, we 
would first complexify our differential equation, proceed as above, and then 
isolate the real or imaginary part as appropriate. 


Exponential Shift 


The other case to consider for F(a) is when it is a polynomial in x, written 

as F(a) = g(a)e”*. For reasons we will see shortly, we will rewrite this as 
F(a) = ve" for some polynomial v(x) (where we could always set r = 0). 
Applying the product rule, we observe that 


D(ve™) =e" Du + vre™ = e™(D+r)u. 
Taking a second derivative gives 


D?(ve"") = D(e™*(D+r)v) 
=e™D((D+r)v) + ((D+r)v)re™ 
=e"™"(D+r)?v. 


In general, we have 
D* (ve"®) = e™*(D+r)*v. 
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Our linear operator with constant coefficients can be written as a combination 
of these: 
P(D)(ve"™) =e" P(D+r)v. (4.36) 


We had begun our recent discussion by considering P(D)y = g(x)e™ with 
the goal of finding a particular solution. If we let y = ve", then the ODE 
together with (4.36) gives 


g(x)e™ = P(D)y = P(D)(ve"™) =e" P(D+r)v 
5 
ODE (4.36) 


= P(D+r)jv=g(a) (4.37) 


after canceling the e””. If we solve equation (4.37) to find a particular solution 
Up, then we have a particular solution yp = vpe"™ for our original problem. 
With this, we are able to handle the same types of equations as in the previous 
two sections. 


CEE Find a particular solution to y” + 3y’ — 10y = 4x%e~?". 


Solution 

The homogeneous equation has characteristic equation (r +5)(r —2) = 0 and 
these roots cannot give rise to solutions that are the current forcing function. 
With no repeated roots we can proceed as in (4.37) with g(a) = 4a and r = —2 
to solve: 


P(D — 2)v = 4a => ((D — 2)? + 3(D — 2) — 10) v = 4a 
=> (D* — D—-12)v = 4z. (4.38) 


This can be solved using the method of undetermined coefficients where we 
guess a solution of the form v, = Aix + Ag. Substituting into (4.38) gives 


= Aj = 12(Aya + Ap) = Ax. 


/ 


vu, Up 
We then equate coefficients and solve to obtain Ay = =+ and Ay = 3. Our 
particular solution is then 
—2£ 1 —2£ 1 2 
3 gg > oP (Fre ed 


In the case that 7 from the forcing function F(a) = g(a)e"™ is a k-fold root 
of P(D), we rewrite our operator as 


P(D) = Q(D)\(D =r) (4.40) 
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for polynomial operator Q(D), which is equivalent to 
P(D+r)=Q(D+r)D* (4.41) 


as can be seen by a simple change of variables. Equation (4.41) will be useful 
given our previous formula for the exponential shift (4.36). In order to find 
a particular solution, we can’t guess ve’ because this would not give us any 
new solutions using our previous exponential shift derivation. If we think back 
to previous situations when we had repeated roots, we could multiply by x” 
and thus examine 


P(D)(a* ve") = e*P(D+r)(x*v) 
= e"*Q(D+r)D*(x*v). 


We now rename «*v = @ and note that we initially needed to have the x” 
explicit in order to obtain a linearly independent solution. Using the fact 
that we need a particular solution, we then have 


g(x)e"® = P(D)(te"") = e”*Q(D4+1r)D*6 
=e"Q(D+r)u, where u = D's (4.42) 


so that Q(D + r)u = g(a) is the equation whose particular solution we first 
need to find. This requires the method of undetermined coefficients to deter- 
mine up. Because up = D*i,, we integrate k times to obtain d, and note that 
we can ignore any constants of integration because terms that arise from them 
can always be grouped into the homogeneous solution. Finally, we create the 
particular solution of P(D)y = Q(D)(D —r)*y = g(a)e™ as 


rx 


Yp = Upe 
| Example 7| Find a particular solution to (D — 3)?(D? + 1)y = 5ate?*. 


Solution 

The root r = 3 from the forcing function occurs twice in the homogeneous 
solution (because of (D — 3)?) and we observe that Q(D) = D? + 1 so that 
Q(D +3) =(D+3)2+1= D?+6D+10. We then need to set u = D?% and 
then find a particular solution of Q(D + 3)u = 5a’: 


ul’ +6u' +10u = 5a+ 


where we assume 
Up = Aya* + Aga? + Agu? + Aga + As. 


Substituting and equating coefficients gives us 
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We then find %, by integrating up, twice and then multiplying by e?” to obtain 
our particular solution 


237 24 13 3 1 
_ 3a 2 3, 4 5 6 
aos (0° 125° "100° 50° | 60 ) 


Summary of the Exponential Response Method 

We can summarize the steps of the exponential response method of solv- 
ing the nth-order linear nonhomogeneous equation with constant coefficients 
P(D)y = F(a) in which F(x) is exponential, sinusoidal, a polynomial, or a 
combination of these as follows: 


1. Solve the homogeneous equation P(D)y = 0 to obtain the fundamen- 
tal set of solutions. 

2. Write the forcing function F(a) as an exponential, complexifying the 
problem if necessary. 

3. Consider F(a) from 2. 

a. If the roots r from F(x) do not occur in the fundamental set of 
solutions from 1, use (4.25) or (4.27) to write the particular solution. If 
(4.27) was used, be sure to give the particular solution, y,, by separating 
the real or imaginary part as shown earlier in this section. 

b. If F(x) = g(x)e"™ and the roots r do not occur in the homogeneous 
solution, then apply the exponential shift operator and consider the new 
equation 

P(D+r)u = g(z). 


A particular solution, vp, to this equation can be obtained via the method 
of undetermined coefficients and then used to create the particular solu- 
tion, Yp = Upe”™”, for the original system. 

c. If the roots r from F(a) = g(a)e"™” occur k times, factor the operator 
as P(D) = Q(D)(D —r)*. Then find a particular solution to 


Q(D +r)u = g(x) with up = D* (vp). 


Finally, integrate k times to obtain v, (ignoring constants of integration) 
and set Yp, = vpe"”. 


We finish with an example of a sinusoidal function with repeated roots. 


pCR Find the general solution to (D — 3)(D? + 1)y = 4x cos. 


Solution 
Unlike the other problems in the section, we are now asked to find the general 
solution. To find a particular solution, we first complexify the problem as 


(D — 3)(D? + 1)y = 4¢Re(e*) — (D — 3)(D +1)(D -—1)z = 42e", 
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where we have written D? + 1 as a product of its (complex) linear factors. 
This allows us to see that, in the complexified form, r = 7 is a root that 
occurs once in the homogeneous equation. We thus need to consider Q(D) = 
(D—3)(D+i). Applying the exponential shift operator and canceling the e”” 
terms gives 

Q(D +i)u = (D+i-3)(D+i+i)u = 4a, 


where u, = Dv, and zp = e’* vp. Expanding this gives us 
(D? + (—3 + 3i)D + (—2 — 67))u = 42. (4.43) 


This is a differential equation with complex coefficients but we can proceed 
as usual with the method of undetermined coefficients. We assume up = 
A,x + Ag, where Aj, Az are complex numbers, and substitute into Equation 
(4.43): 


(—3 + 3i) Ay + (—2— 67)(Aya + Ag) = 4a. (4.44) 
Ss? oo 
thy Up 


We equate coefficients of x to find 


P =]. 2 2-374, =<of 3. 
; _ = 


B= a 


We integrate u, to find vp: 
f= 4 3. ay —21 7 3. 
2 i091) 50 | 50)” 


Finally, the particular solution to the complexified equation is z, = eo, and 
we want the real part: 


-1 21 —3 3 
Yp = (3 - a") cos x + ($2 - 5) sin x. (4.45) 


For the solution of the homogeneous equation, we see the roots of the charac- 
terstic equation are r = 3, +7 so that 


Yo = Cye** + Cosinx + C3 cos x. 


Thus our general solution is 


-1 21 3 3 
y = Cie®® +C2 sin z+C3 cosr+ (2 _ a°) cos 7+ (F” — =) ie 
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Problems 


In Problems 1-16, use the exponential response formula to find a particular 
solution. The exponential shift is not needed for any of these. 


Al y" +y=e"* 2. y" + 4y = 3e* 

3. y” —y = 4e%* 4." + 2y! = e* 

5.y” +4y =3 6. y" —4y=5 

7. y" + 2y! + 2y = 3cos 2x 8." + 4y' + by = 4sin 32 

9. y" — dy = —e?* 10. y" +y' =5e* 

11. y’ — 9y =e 12. y” + 2y/ = 3e~** 

13. y” + 2y' + y = 2e* 14. y" + 4y' + 4y = e"** 
15. y” + 2y! + 2y = —2e-* cosx 16. y” + 4y' + 5y = e~** sing 


In Problems 17-24, use the exponential shift formula followed by the expo- 
nential response formula to find a particular solution. 


17. 
19. 
21. 
23. 


y” + 4y = xe* 18. y"” +y = 4re?* 

y" +9y = 27 +3xr-1 20. y/' +y' =axsine 

y” —9y = xe“ 8” 22. y" + 2y! = 2x7e-?% 

y” + 2y! + 2y = 2e-* cosx 24. y" + 4y' + 5y = ve?" sin x 


In Problems 25-34, find the general solution. If an initial condition is given, 
find the solution that passes through it. 


25. y” — 2y' — 8y = 4e2” — 21e- 3% 26. y" +y' — by = 2a 
27. y" — 2y' + 2y = «cosa 28. 4y” — 4y’ — 3y = cos 2x 
29. y+ 10y"” + 34y’ + 40y = re~*” 30. y® — 18y” + 81y = e?* 
31. y” — 4y = 322, y(0) = 0, y'(0) = 6 32. y’+y = cosa, y(0) = 1, y/(0) = —-1 
33. y” — 3y’ + 2y =e", y(0) = 1, y'(0) =0 
34. y” — 2y' — 3y = 3ze7", y(0) =1, y'(0) =0 
35. The exponential response method can be used to solve first-order con- 
stant coefficient nonhomogeneous equations. Use this method to solve 
the following problems: 
(a) y! — 4y = 2° 
(b) y! +y = cos 2a 
(c) y’ -y=e* 
36. Suppose that yi(a”) and y2(x) are solutions of 


dy dy 
aja th + ey = f(x ); 


where a,b, and c are positive constants. 


(a) Show that 
lim [y2(x) — yi(x)] = 0. 


Loo 
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(b) Is the result of (a) true if b = 0? 
(c) Suppose that f(x) = k, where k is a constant. Show that 


. k; 
Im ve) =f 
for e oluti (x) of EY al =k 
or every solution y(x) of a> + b=” + cy =k. 
; ' ay |, dy ert 
d) Determine the solution y(x) of a—> + b— =k. Find lim y(z). 
da? dx a—900 
e) Determine the solution y(x) of a— =k. Find lim y(a). 
dx? LOO 


37. (a) Let f(a) be a polynomial of degree n. Show that, if b 4 0, there 
is always a solution that is a polynomial of degree n for the equation 
y" + ay’ + by = f(a). 

b) Find a particular solution of y” + 3y’ + 2y = 9 + 2x — 227. 


38. In many physical applications, the nonhomogeneous term F(x) is speci- 
fied by different formulas in different intervals of «. 
(a) Find a general solution of the equation 


DD pp ae e,0<a¢<1, 
ee a ae 


Note that the solution is not differentiable at x = 1. 
(b) Find a particular solution of 


4.5 Variation of Parameters 


The method of undetermined coefficients (either via tables or annihilation) 
does not apply to functions F(a) that are not already solutions to some linear 
constant-coefficient homogeneous differential equation, nor to equations with 
variable coefficients. We will now develop a general method that applies to all 
nonhomogeneous linear equations. The only catch is that it requires knowl- 
edge of the homogeneous solution yet does not give us a method for finding 
this solution. If the homogeneous part of the equation has constant coeffi- 
cients, we can use the previous methods to find the complementary solution. 
If the homogeneous equation has non-constant coefficients, we must be given 
the solutions in order to apply this method. 
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Consider the nonhomogeneous equation 
y’ +y=tanz. (4.46) 
The nonhomogeneous term 
F(a) = tana 


is not of the form 
xv), xe", xe cos bx or xe sin ba 


so our previous methods will not work here. The variation of parameters ap- 
proach, which was discovered by Lagrange, is a method that finds a particular 
solution for the differential equation. The idea is to use the general solution 
of the corresponding homogeneous equation 


y’ +y=0 
to find a particular solution. In this case, the characteristic polynomial is 
rt+il= 0, 
which gives the solution 
Ye(x) = cy sina + c2 cosa. 
We will seek a particular solution of the form 
Yp(@) = ui (x) sine + ue(x) cos x (4.47) 


where we have replaced the constants c, and cz by unknown functions u;(z) 
and u2(x). 

Thus, we see how the name of this method applies. We vary the parameters 
c, and c2 by allowing them to be functions of x instead of constants. Notice 
that there should be many choices for ui(a) and u2(a) because we have two 
unknown functions and only one equation, the nonhomogeneous differential 
equation, to use to find them. Because we know that y, must be a solution 
to (4.46), we substitute it into this equation. Differentiating y, gives 


yp(x) = U1 (a@) cosa” + uy (a) sin a — ug(x) sin x + ug(x) cos x. 


Now to simplify the process of finding ui(a) and u2(x), we impose our first 
restriction 
uj, (x) sin + u(x) cosx = 0 (4.48) 


on u;(a) and u2(x). We can think of this condition as arising from the assumed 
form of the particular solution in the case where the two functions u;(x) and 
u2(x) are actually constants (and thus we would have ui = us = 0). Even 
though, in general, our two functions u1(),u2(a”) are actually not constant, 
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we are simply imposing a condition that will allow us to find suitable functions 
that will make y, a solution. 


Because of our restriction in (4.48), we have 
y;(«) = ur (x) cosa — ug(x) sine. 
The second derivative of yp is thus 
Yp (x) = —ur (x) sina + u(x) cos x — ug(x) cos x — uy (x) sine. 
Now we substitute y, and TM into the nonhomogeneous equation to obtain 


yp () + Yp(x) = —ur (a) sin a + uj (a) cos a — ug(a) cos a — uy (a) sin x 
——————— ee eee 


+ui (a) sin + u2(x) cos x 
————L_L SSS 
Yp 


= uj, (x) cosx — us(x) sina. 


Since y, is a particular solution, we know that it must satisfy the nonhomo- 
geneous equation. We thus have our second restriction on u;(x) and u(x), 
namely, 


u; (a) cosa — us(ax) sinav = tanz. (4.49) 


Our two restrictions, Equations (4.48) and (4.49), give us a system of two 
equations in the two unknown functions u4 (2), u(x), 

ui (x) sina + u5(x) cosa = 0 
(4.50) 


—u} (av) cosa + u5(x) sina = tans, 


which we can solve for u(x) and u4(a). We could use Cramer’s rule (see 
Appendix B.2.2 for a self-contained review of it) to solve this or simply ma- 


nipulate the equations to solve. 
In the former case, we have that 


0 cos © 
j tanxz —sing 
ui (a) = —— 
sing cosz 
cosxz —sing 
(0)(— sin x) — (cos 2) (tan 2) —cos x tana 


(sinx)(—sinaz) — (cosx)(cosx) -1 
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and 
sin x 0 
cosx tanz 
uy(z) = >= 

sing  cosx 

cose —sing 
(sinz)(tanz)—(cos#)(0) __ sinxtanz 

~ (sinz)(—sinz)—(cosz)(cosz) —-1 ~ 


To find the two functions, we simply need to integrate. This gives 


— t 
u(c) = {ee de = f sine dx = — cosa 


and 


sinxtanx —sin? x . 
u2(x) = | ——— dx = | —— dr =sinz — In|seca + tana}. 
—1 COS & 


Note that any antiderivative of u4(a#) and u4(x) is possible as a choice for 
ui(x) and ua(a), respectively. We have simply taken the one with constant 
zero. Substitution into (4.47) gives the particular solution 


Yp(x) = un (2) yr (@) + U2(2)y2(x) 
= —cos2# sing + (sina — In|seca + tan a|)cos x. 
—SS —’ “Ss” ‘ pan 
U1 Y1 U2 Y2 
Thus, the general solution is 
y(@) = Ye(@) + p(x) 
=csing+cgcosx —cosasinx + (sina — In|seca + tana|) cosa. 
a ee —E————EE—E ES SSS 
Ye Up 


In general, to solve the second-order linear nonhomogeneous differential 
equation 
ag(x)y" (ax) + a1(x)y"(x) + ao(a)y(x) = F(a), 
where 
Ye(x) = crys (x) + c2yo(ax) 
is a general solution of the corresponding homogeneous equation 


ag(x)y"(x) + ar (x)y' (a) + ao(x)y(a) = 0, 


we divide by the lead coefficient a2(x) to write 


y" (x) + p(x)y' (a) + q(x)y(x) = G(2). 
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At this point, we need to be given or be able to calculate a fundamental 
solution set {y1(x), y2(x)} for the homogeneous equation. If the homogeneous 
equation has constant coefficients this is done by our previous methods; if 
the coefficients are not constant, we must be given the fundamental set as 
the methods for calculating these are beyond the scope of this text. We next 
assume that a particular solution has a form similar to the general solution 
Ye by varying the parameters c; and cg, that is, we let 


Yp(x) = ui(x) yi (x) + u(x) yo(z). 


We need to determine u;(x) and u2(a), so we seek two equations by substi- 
tuting yp into the second-order linear nonhomogeneous differential equation 


yf" (x) + p(a)y'(w) + a(a)y(@) = G(2). 
So, differentiating y, gives 
Yp(@) = un (a)yi (a) + uf (x) yr (@) + U2(x)yo(@) + ug (@)yo(a) 
which simplifies to 
Yp(@) = ur (x)yi (x) + U2(x)yo(x) 
by making the assumption 
ui (x) yi (2) + un(2)yo(x) = 0. 
The second derivative is 
Yp (x) = ur (x)yi (w) + uy (ar) yh (a) + Ua(a) ys (x) + un(@)yo(2). 


Now we substitute these expressions into the second-order linear nonhomo- 
geneous differential equation to obtain 


Yp (x) + p(x)y, (x) + a(x) yp (a) 
= ur(x)yy (x) + ui (x)y) (©) + u2(a)ys (a) + u5(x)y5 (x) 
+p(«) [us (a)y; (a) + u2(a)y5(a)] + a() [ur (w) yi (w) + ua(x)yo(x)] 
= u,(2) [yf (x) + p(x)y (x) + a(x) yi (2)] 
=0 
+u2(2)[y3 (x) + p(x) yp (x) + a(x) y2(x)] + uf (a) y) (x) + ug (x)y5 (a), 
=) 


where the “= 0” terms hold because y;(x) and y2(a) are solutions of the 


corresponding homogeneous equation y” (x) + p(x)y’ (a) + ¢(a)y(x) = 0. Since 


y" (x) + p(x)y'(x) + a(x)y(x) = G(2), 


4.5. Variation of Parameters 291 


it follows that 
uy (a)y} (2) + up (x)y3(a) = G(z). 


Hence, we have the second equation of our system needed to determine wy (x) 
and u2(x). Specifically, 


Using Cramer’s rule to solve this system (see Appendix B.2.2 for a brief 
review), we have the unique solution 


| 0 yo(x) 
via) = E2_e)] _ =walWrGn 
and 
yi (x) 0 
ea) = eG] _ wel 
, W(x) W(x) ? 
where 


We note that W(x) 4 0 because {yi (x), yo(x)} is a fundamental solution set 
and thus we know that y;(#) and y2(x) are linearly independent. 


Summary of Variation of Parameters Method 


Rewrite the given second-order equation so that the leading coefficient is 
one: 


y" (x) + p(a)y'(x) + a(a)y(x) = G(z). 
Then follow the following 5 steps: 


1. Find or be given a complementary (homogeneous) solution 
Ye(@) = cryi(@) + c2y2(x) 
and fundamental solutions 
S = {yi(x), yo(x)} 


of the corresponding homogeneous equation 


y" (x) + p(x)y'(x) + a(x)y(x) = 0. 
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2. Let 
_ =Y2(x)G(z) 


/ yi (@)G(x) 
u(x) - W (a) 


and u}(a) = ie) 


3. Integrate u(x) and u5(x) to obtain u1(a) and u(x 
) 


4. A particular solution of y(x) + p(x)y/(x) + q(x)y 
given by 


). 
(x) = G(z) is 
Yp(x) = ur (x)yi(@) + U2(x)yo(z). 
5. The general solution of y/’(«)+p(x)y'(@)+¢(x)y(x) = G(x) is given 
by 
y(x) = Ye(x) + Yp(@). 


|Example 1, Solve y” — 2y' +y =e" lInz for x > 0. 


Solution 
The corresponding homogeneous equation y” — 2y' + y = 0 has the character- 
istic polynomial 

m? —2m+1=0 


so that the corresponding solution is 
Ye(x) = c1e” + cone”. 


Thus, 
yi(a) = e* and yo(a) = xe”. 


So, S = {e*, ze”} and 


This gives 
= Z (ex | 
tae ‘| eA 


segs AEE, 


Both of these integrals can be obtained by integrating by parts and are 


and 


1 1 
ui(z) = —2" — su Ina 


4 


and 
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The particular solution is 


1 2 1 2 x x 
=| -a2° —-a"lInz) e” +(alna—2) we 
4 2 Sayer a 
YI U2 Y2 


U4 


1 3 
= ste Inz — ee 


This gives the general solution as 
y(@) = Ye(@) + Yp(x) 


1 3 
= cje” + coxe” + sre Ing — qe. 


It is often convenient to use MATLAB, Maple, or Mathematica to quickly 
calculate our determinants and evaluate the integrals. 


|Example 2 Solve the nonhomogeneous equation 


1 
y+ qu sec 5 + cs¢ 5 (4.51) 


on the interval 0 < x < 7. 


Solution 
The characteristic equation is 


1 
2 
+—-=0 
"4 
with corresponding solution 
(x) = e1 cos 5 + cg sin = 
Ye(z) = C1 cos 5 + ca 8in 5. 


We thus let - : 
yi (x) = cos 5 and yo(x) = sin 5 


and calculate 
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This gives 


u(e) = f 2sin 5 (see 5 ese 5) dx 


J 


= —2 + 4In eos = 


ug(x) = [20085 (see = + csc =| daz 


= 27+41n 


sin —|. 
Thus, a particular solution is given by 


Yp(@) = ur(x)yi (x) + U2(x)yo(x) 


(—2 + 41n cos =)) cos 5 t (2 + 41n sin S|) sin 5 
Ss a 
U1 Y1 U2 Y2 


and the general solution is 
y(@) = Ye(@) + Yp(x) 


x 4 . 
= Ci COS = C2 Sin — 
2 2 


+ (—2x + 4In eos 5) cos 5 + (20 +4In 


nol) s 
sin —| } sin —. 
2 2 


a 
| Example 3 | Verify that y-(x) = c,2~! + cox solves the homogeneous part 
of 

d’y | dy 
2 22 


for « > 0. Then use variation of parameters to solve the nonhomogeneous 
equation. 


Solution 
We can easily show that y, is a solution by substituting in y., yc’, ye” into the 
homogeneous equation. Letting 


yi(z) =a" and yo(z) =z 


we have 
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which we note is not zero for any real x. This gives 
wu (2) = Fate and us(x) = —e?*, 
so 


—3 
ui(a“) = / sre da 


3 
= ~ (22° — 2x + 1)e?* 


integrating by parts twice and 


So a particular solution is given by 


Yp(x) = ur(x)y1 (x) + U2(x)yo(z) 


and the general solution is 
y(x) = Ye(@) + Yp(x) 


1, 3 3 


=cC2 "+ Co& g (22 2+ ot )e**” — —ze*”. 


Higher-Order Equations 
Variation of Parameters extends to higher dimensions. We consider an nth- 
order equation with leading coefficient equal to one: 


y™ + pi(x)y—) +... 4+ pa—1(2)y! + pax) y = G(z). (4.53) 


If {y1, y2,°-* , Yn} is a fundamental set of solutions for the reduced equation, 
then we assume a particular solution of the form 


Yp = U1 (@)yy + U2 (@)y2 + +++ + Un(X)Yn 
where the u;(x) are determined by the system of equations 
yu, + youn +--+ Ynu, = 0 


Yiu, + Youy +--+ Yu, = 0 
(4.54) 


yr Pu + yuh to ty Pal, = G(2). 
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Using Cramer’s rule, we can calculate the functions u/,(a) that we will inte- 
grate. In the case of the third-order equation with fundamental set of solutions 
{y1,y2,y3}, we write a particular solution in the form 


Yp = Ur(@)y1 + U2(x)y2 + u3(@) ys, (4.55) 
where 
O yo Ys yi «(=O "3 yi y2 O 
0 Yo Y3 yy OO YS yi yy O 
rp, (G(x) yz vs}, [ut Gz) ys}, . fut 3 G(x) 
u} (x) = ~——=—-,, u4(z) = —————,, u(x) = 
Yi Y2 YB Yi Y2 YB Yo y2 YB 
Yi Ye YS Yi Yo YS Yi Ye 3 
yi ¥3 YS yi Ys Y3 yi ¥3 YB 


We then integrate the ui and plug into (4.55) to obtain a particular solution. 
For higher-order equations, we again solve (4.54) and then integrate to obtain 
the u;(x). The particular solution is created and thus we are able to write the 
general solution. 


e e e e e e e e@ e e e e 
Problems 


In Problems 1-15, find the general solution using variation of parameters. If 
an initial condition is given, find the solution that passes through it. 


1 


Wr iN / x 
ly Gage . le es 
3. Wi +y=5 4. y" +2! +y=— 

ax x 
B. y"” + 4y = csc 2a 6. (D—1)3(y) = — 
a 
7. D(D+1)(D-2)(y) =2° 8. y — 16y =e 
9." — Ty! + 10y = e°*, y(0) = 1, y'(0) = 2 
10. y" + 5y’ + 6y = e~*, y(0) = 1, y/(0) = 2 
11. y”+y=seca,y(0) = 1,y'(0) = 2 


13. y" +y =sin? x, y(0) = 1,y/(0) =0 

14. y"+y = tanz, y(0) = —-1,y'(0) =1 

15. y” + y =sec? x, y(0) = 0,y/(0) =1 

16. Solve y” + 4y’ + 3y = 65cos 2x by 
(a) the method of undetermined coefficients or exponential response; 
(b) the method of variation of parameters. 
Which method is more easily applied? 


y 
y 
12. y"+y= 62, y(0) =1,y/(0) =1 
y 
y 


In Problems 17-20, consider the differential equation and fundamental set of 
solutions. First check that the given fundamental set of solutions is actually 
a fundamental set of solutions. Then use variation of parameters to solve the 
equation. 
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17. 2x?y'” + 6xry"” = 1, x > 0; {1,1/2, x} 


1 1 1 
18.4" = =) BSG (ela) 
re £ BT 
MW 1 if: 1 i j 
19. y+ —y + >y= -, «> 0; {sin(Inz), cos(inz)} 
x x x 
=i x 
20. y+ ss = . , > 0; {1,(1+2)e-*} 
x 1l+2 


21. Show that the solution of the initial-value problem 


yf!" (x) + ay (a)y"(@) + ao(x)y(x) = f(a) 


with y(xo) = yo, y/(%o) = yo can be written as y(x) = u(x) + v(x) where 
u is the solution of 


u(x) +.a1(x)u'(x) + ao(x)u(x) = 0 
with u(a%o) = yo, u’ (ao) = yo and v is the solution of 
u(x) + ay(x)u'(a) + ao(x)o(x) = f(x) 


with v(x) = 0,v'(%o) = 0. 


4.6 Cauchy-Euler (Equidimensional) Equation 


Up to now, all of the second-order differential equations that we have con- 
sidered were linear with constant coefficients. As we have seen, these equa- 
tions occur in applications, but they are not the only type of second-order 
differential equations for which we can develop a method of obtaining an ex- 
plicit solution. We will now consider the Cauchy-Euler equation? which is 
defined by the second-order differential equation 


aga?y"” + ary! + azy = f(a), (4.56) 
where the coefficients a; are constant. 


Electric Potential of a Charged Spherical Shell 


Following Lomen and Lovelock [32], a differential equation that occurs in 
describing the electric potential of a charged spherical shell is given by 


7 


ay” + 2ay' —n(n+1)y =0 (4.57) 


where «x is the distance from the center of the spherical shell and y is the 
potential. Here n is a positive constant. This differential equation is of a 


?This equation is also called an equidimensional equation, or Euler-Cauchy equation. 
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form we have not previously considered: it is second order, but does not have 
constant coefficients. Comparing it with Equation (4.56), we see that it is a 
homogeneous Cauchy-Euler equation. 

To solve this equation, we will now consider a method of solution of (4.57) 
analogous to our work in Section 3.1; however, here we replace zy’ and x7y". 
To do this, we will change variables from the independent variable x to a new 
independent variable t, where 
dy _ dy 


dt” dx’ 
Applying the chain rule, we have that 
dy _dydz 


dt dx dt 


so that we can relate « and t by the differential equation 


This the differential equation which has solution 


z(t) = ce’ 


and thus suggests that we use the change of variables 
g=e',ife>0 andz=-e', ifz <0. (4.58) 


In this example, x > 0 as distance is measured positively, so we take x = e! 
which gives t = Inw. Differentiation with respect to x then gives 


dt 1 


dx x 


Thus, using the chain rule, 


dt dxdt dz dx’ 
that is d F 
y y 
=e 4.59 
“ae dt ae) 


Using this in (4.57) we can replace the 2ady/dx term by 2dy/dt. Now similarly, 
the x7d?y/dx? term can be replaced; if we differentiate (4.59) with respect to 
x, we have 

dy ddy dy dt 

dx dxdt dt? dx’ 


Multiplying by x gives 
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so that ; 
ody dy dy 


Substituting (4.59) and (4.60) into (4.57), we have 
dy | dy 
—— 4+ — — 1l)y = 0. 4.61 
2 ar n(n+1)y =0 (4.61) 


This is a homogenous second-order linear differential equation with charac- 
teristic equation 
r?+r—n(n+1)=0 


which has solution 
r=nandr=-n-l. 


Thus, the solution to (4.61) is 
y(t) = cer" +4 ge ere, 


Expressing this equation in the original variable x, we have the general solu- 
tion to (4.57) as 
y(x) = cy” + ga MD), 

If we consider the potential inside the spherical shell, from symmetry consid- 
erations we expect the potential to be zero at the center x = 0, which we 
have if we choose cz = 0. If we are dealing with the potential outside the 
spherical shell, we expect the potential to go to 0 as  — ov, so we would 
choose c, = 0. Thus, for either situation we obtain a bounded solution of the 
differential equation. 


Following the work in this example, we see that the homogeneous Cauchy- 
Euler equation 
aga? y” + avy! + aay = 0, (4.62) 


where the coefficients a; are constant, has solutions of the form y = 2”. 


Substituting y = x" into (4.62) gives 
agx?(r(r — 1))2”~* + ayzraz”—' + aga” = 0, 
so that simplifying we have 
a" (aor? + (a, — ag)r + ag) = 0. 
Noting that x = 0 yields the trivial solution, we have the characteristic equa- 
tion 
apr? + (a, — ag)r + ag = 0. (4.63) 


We again have three different cases to consider depending on the roots of 
this equation: if the roots are real and distinct (r1 4 r2), if the roots are real 
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and repeated (71 = 2), and if the roots are complex (r; = a + bi). However, 
we note here that we do not need to reinvent the wheel. We know what the 
solutions look like in each of these cases; the only difference here is that we 
need to apply the appropriate change of variables « = Int as motivated in 
(4.58). 

In the case that the roots are real and distinct, two linearly independent 
solutions are x"! and x"? and the general solution is 


y(x) = ca"! + con”. 


If the roots are real and repeated (r; = rz), then two linearly independent 
solutions are x"! and x"! Inz and the general solution is 


y(a) = a"! + coe"! Ing. 


If the roots are complex again, non-real (r; = a + bi), then two real-valued 
linearly independent solutions are x sin(blInz) and x cos(bInz) so that the 
general solution is 


y(x) = qa" sin(bln x) + ca" cos(bInz). 


y dy 
Qn? = + 32 —y= 
dx? - “da * " 
Changing variables from x to t where x = e! gives 
dy | dy 
2— +—-y=0 
a 


which has characteristic equation 
2r?+r—-1=0. 


The roots of this equation are r; = 1/2 and rg = —1 so that the general 
solution is : 
Y=Cyx? + con. 


i] 
| Example 2 Rt 
d?y dy 
2 4%" + 2y = 
oe or a y =0 


for x > 0. 
Applying the change of variables x = e' gives 


dy dy 
SO ih Da a 
det qe tu % 
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which has characteristic equation 
ret+r+2=0. 


The roots of this equation are 


—-1l+t VTi 
2 


so that the general solution is 


sin(/7Inz) | _ cos(/7Inz) 


y(a) =c¢ We + Cg a ; . 
e e e e e e e e e e e e 
Problems 
In Problems 1-16, solve the homogeneous Cauchy-Euler equation by finding 
the general solution of the following differential equations, assuming x > 0. 
1. 2?y” + 42y’ + 2y =0 2. x7y" + 32y’ +y =0 
3. x7y" + ry’ +4y =0 4. x7y" + 3ay' + 2y =0 
5. x7y" + 1llay’ + 21ly =0 6. 2x7y" + cy’ —y =0 
7. 2x7y" — 3ay' + 3y = 0 8. 27y"’ — 3ay’ + 3y = 0 
9. xy" — 32y' + 4y = 0 10. x?y! + 3ry' — 2y =0 
11. 2?y" + 5ry’ — 3y =0 12. 3x7y" + 32y’ + 9y = 0 
13. 7x7y" + 5zy’ +y =0 14. xy” + 5ry’ + 8y =0 
15. 327y" + 132y’ + lly = 0 16. 3x7y" + 5ry’ +y =0 


17. Show that if y,(¢) and yo(t) are linearly independent functions of t and 
satisfy a second-order linear differential equation with constant coeffi- 
cients, then Yi(a”) = yi(Inx) and Y2(a#) = y2(Inz) are linearly indepen- 
dent functions of x for « 4 0. 


Solve the nonhomogenous Cauchy-Euler equations in Problems 18-20. 
18. x?y" + dry! + 2y = e* 19. x7y" + 32y’+y=Ine 
20. x?y"” + xy’ + 4y = 2 


4.7 Forced Vibrations 


In Section 4.1, we motivated studying nonhomogeneous equations by using 
a forced mass on a spring as motivation. Equipped with our knowledge of the 
method from this chapter, we can take a closer look at the phenomenon of 
resonance. We will consider the case of undamped motion and then damped 
motion and then we will investigate the analogous electric circuit equations. 
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Resonance of a Forced Mass on a Spring with No Damping 


We begin with a classic example of a mass on a spring without friction. 


dx 


m2 +ka = Fosin(wt), (4.64) 
where w denotes the forcing frequency. The solution of the homogeneous 
equation is easily seen to be 


k 
x-(t) = Ci sin(wpt) + C2 cos(wnt), Wn = = 


where Wp, = 4/ za as before. Any of the methods in Sections 4.2-4.5 will 
work in the following derivation and we choose the method of undetermined 


coefficients. A particular solution has the form 
x,(t) = Asin(wt) + B cos(wt) 
and we can substitute this into the equation to determine A and B. In doing 


this, we obtain 
Fo 


A= —~.—.,, B=0. 4. 
m(w2 — w?)’ 0?) 
Our particular solution is then 
Fi 
x(t) = ° sin(wt). 


mw, — w) 


We immediately see a peculiar feature of our particular solution, xp: it be- 
comes unbounded as w — w, and this phenomenon is known as pure res- 
onance. That is, our oscillations will grow without bound as the forcing 
frequency approaches the natural frequency of the system. In any real sys- 
tem, we will always have some amount of damping; however, if the damping 
is small enough, we can still have sufficiently large oscillations that will cause 
a breakdown of the mechanical system. 


Resonance of a Forced Mass on a Spring with Damping 

While unbounded oscillations were possible in the undamped case, we will see 
this cannot happen when damping is present. We first consider the familiar 
equation 


maa + ba + ka = Fo sin(wt) (4.66) 


and then immediately rewrite it as 


dx dx 


Fi 
7D turer = = sin(wt), (4.67) 
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where w denotes the forcing frequency, ¢ = b/(2mn) denotes the damping ratio, 
and w,, denotes the natural frequency (see Section 3.7). As in the undamped 
case, any of the methods in Sections 4.2-4.5 will work in the following deriva- 
tion and we will use the method of undetermined coefficients. We thus assume 
the particular solution has the form 


x,(t) = Asin(wt) + B cos(wt). 


We leave it as an exercise for the reader to show that substitution into the 
differential equation (4.67) gives 


Fo(w — w) 


A= 4, 
fileCaPat + (i ua) ee 
7 —2wCwy, Fo 
B= daa? + (w® = 02] ee) 


With the details again left as an exercise, we use our now-favorite trigono- 
metric identities to obtain® 


Fo/m 
et) = Vf 4C2w2w? + (w? — w?)? re eae 
where B A 
cos @ = JB? and sing = Ate Be (4.71) 


We know that the homogeneous solution decays exponentially and it is only 
the steady-state solution that determines the long-term behavior of the sys- 
tem. The amplitude of these steady-state solutions is thus given by the factor 


_ Fo/m 
f4C2w2w? + (w? — w2)?” 


g(w) 


(4.72) 


We often refer to (4.72) as the gain for (4.67) and together with the phase 
lag given in (4.71) we refer to this as the frequency response formula. 
Engineers will often consider complex gain, which just means that we begin 
by writing our forcing function as a complex exponential 

dz dz 


F,. 
i es 0 iwt 
qe + 2Gwy, Ai + wz me” (4.73) 


and then go through the same derivations to obtain 


_ Fo/m _ Fo/m 


g(iw) = — = - ; 4.74 
gliw) P(iw)  w2 — w? + i2Gwpw ms 
3 As in Section 3.7, we also could have used cos ¢ = Ta and sing= Tes to 


obtain sin(wt + ¢) instead of cos(wt — ¢) in (4.70). 
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We can observe that Equation (4.72) is simply the absolute value of (4.74): 


g(w) = |g(iw)).- 


The gain is a way for us to characterize how the forcing frequency affects 
the amplitude response. For a given forced mass-spring system, we can only 
change the frequency of the forcing, that is, w. The frequency that makes 
Equation (4.72) as large as possible is the resonant frequency. Because we 
consider w as the only variable, finding the resonant frequency reduces to the 
problem of finding the w that makes this function have its maximum value. 
We leave it for the reader to show in Problem 9 that the resonant frequency 


is 
Wres = Wn 1 — 2¢2, (4.75) 


where ¢ = b/(2mn) Wy = \/k/m. This can be done by taking the derivative, 
setting it equal to zero, and finding the critical points. When Equation (4.75) 
is real-valued, it will give the maximum gain; otherwise w,e¢, = 0 will give the 
maximum gain. Using the original equation containing m, b, k, this formula 
becomes 


k bY 
res — — —2| . . 
Ww _ (=) (4.76) 


There is no longer guesswork in determining the resonant frequency for Equa- 
tion (4.66). For forcing functions that are exclusively in terms of cosine or in 
terms of both sine and cosine, the derivation is similar. 


| Example 1| Determine the resonant frequency for 3a”+2a'+2a7 = Fo sin(wt). 


Solution 
For this problem, we have m = 3, b = 2, k = 2. Plugging into (4.76) gives 
2 
Wres = 5: 
3 


In the alternative formulation given by (4.75), we have w, = \/2/3, ¢ = 1/V6, 


and obtain the same answer. = 


Forced Resonance in Electric Circuits 


We again consider the electric circuit from Section 3.7. We had found the 
resulting differential equation as 


dQ Rie ia 
di? “dt °C 
We can equivalently rewrite this in terms of J by taking the derivative of each 
term: 


L 


Q=E. (4.77) 


@I dl 1 ; 
Lag tRatGi=é. (4.78) 
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1 3 


FIGURE 4.3: Basic RLC circuit with differential equations (4.77) or 
equivalently, (4.78). We extend the work from Section 3.7 by now considering 
forcing from the supplied voltage € 4 0, often known as the electromotive 
force or emf. 


Switch R 


The analogous formulation for no damping in the mass-spring system is 
to remove the resistor from the electric circuit. In doing so, our differential 


equation becomes 
d2I 
L—, ape : 4, 
qe +a GC oe (4.79) 


Dividing by J, letting w) = —=s, and considering €’ = Fo sin(wt) allow us to 
& by g ae g 


LC’ 
rewrite (4.79) as 


or Fo 
qe +upl= 7 ° sin(wt). (4.80) 
Analogous to (4.64), solutions to the homogeneous equation are of the form 
F 1 
I(t) =C; sin(wot) + C2 cos(wot), Wo = VIG 
A particular solution is found to be 
Fo 


As with the mechanical analog, we see that tuning the forcing frequency such 
that w— wo will cause solutions to grow without bound. 
Including resistance in the circuit gives us a differential equation (4.80) 


@I RdI 1 Fy 
= i t). 4.82 
w@tbtatic 7, Sint) (4.82) 


We make the substitutions wo = we and ¢. = Ry / ¢ and rewrite this as 


PI dI F 
az + 2Xewo + wel = 7 sin(wt). (4.83) 
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This is the same form as the forced mass on the spring! We note that the 
parameter ¢. is again called the damping ratio as it has the analogous 
meaning as it did in the mass-spring system. A particular solution takes the 
same form as before and we again find its amplitude: 


() = mult 
oe V4C2wew? + (w? — we)2 


The resonant frequency corresponds to the w that makes this a maximum: 


Wres = wor 1 — 2¢2 (4.85) 


(4.84) 


or, equivalently, 
1 R\? 
Wres = to —2 (+) . (4.86) 


Problems 

In Problems 1-4, find the gain and resonant frequency for each of the forced 
oscillators (either a spring-mass system or circuit). Then plot the gain as a 
function of w. 

1.2” +92 = 5sinwt 2.0" + 30' +42 = 4Asinwt 

3.0" + 62’ + 9x = 2sinwt 4. 2" + 6a’ + 252 = 3sinwt 


In Problems 5-6, find the general solution for the current in the RLC circuit 
with given parameter values. 

5. R = 3000, L = 1.25H, C = .0001F, € = 100sin 10¢V 

6. R= 1000, L = .02H, C = .00001F, € = 120sin 30tV 


7. Derive Equations (4.68)-(4.69), which give the constants of the particular 
solution. 

8. Derive Equation (4.70), thus obtaining the amplitude-phase form for the 
particular solution. 

9. Derive the resonant frequency equation (4.75) for the forced mass-spring 
system. 


Problems 10-12 focus on alternative formulation for a forced mass on a spring. 
After deriving the equation of motion, solve the equation for forcing function 
y = sinwt. 


10. Consider the spring-mass-dashpot system given in Figure 4.4. 


Use Newton’s 2nd law to show that the equation of motion is given by 
ma" + ba’! +kx = ky, 


where b is the damping from the dashpot. 
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k 


dashpot 
b> rs 
J 
FIGURE 4.4: Spring-mass-dashpot system for Problem 10 with damping 
coefficient b from the dashpot. 


11. Consider the spring-mass-dashpot system given in Figure 4.5. 


dashpot 


Ea > 
J 


FIGURE 4.5: Spring-mass-dashpot system for Problem 11 with damping 
coefficient b from the dashpot. 


Use Newton’s 2nd law to show that the equation of motion is given by 
ma" + ba! + kx = by’, 
where b is the damping from the dashpot. 


12. Consider the spring-mass-dashpot system given in Figure 4.6. 


FIGURE 4.6: Spring-mass-dashpot system for Problem 12 with damping 
coefficient b from the dashpot. 


Use Newton’s 2nd law to show that the equation of motion is given by 


ma” + ba! + ka = by’ + ky, 
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13. 


14. 


where b is the damping from the dashpot. 


Consider the ODE ma” + ba’ + ka = by’, derived in Problem 11. If the 
forcing is given by y = Fosinwt, show that the gain, cf. (4.72), is given 
by 

bFow 


~ J bw? + m2 (w? — w2)? 
Consider the ODE ma” + ba’ + ka = by’ + ky, derived in Problem 12. 
If the forcing is given by y = Fo sinwt, show that the gain, cf. (4.72), is 


given by 
Fov b2w? + k2 


— Jeu? + m2(w2 — w2)2 


g(w) 


g(w) 


Chapter 4 Review 


In Problems 1-6, determine whether the statement is true or false. If it is 
true, give reasons for your answer. If it is false, give a counterexample or 
other explanation of why it is false. 


1. 


6. 


Every linear homogeneous equation with constant coefficients has e’™” as 
a solution, where r is a constant that may be real or complex. 


. For a forced mass on a spring system, the steady-state solution corre- 


sponds to the complementary (or homogeneous) solution while the tran- 
sient solution corresponds to the particular solution. 

For a forced mass on a spring system, the transient solution dies off as 
t — co while the steady-state solution persists. 

If y; is a particular solution of P(D)(y) = sina and yp is a particular 
solution of P(D)(y) = 27, then 3y, — 5y2 is a particular solution of 
P(D)(y) = 3sina — 52”. 


. The method of undetermined coefficients (either via Tables or via the 


Annihilator Method) applies to any nonhomogeneous term as long as the 
associated homogeneous equation has constant coefficients. 


Variation of parameters works for all differential equations. 


In Problems 7-11, consider the particular solutions of their respective forced 
equations P(D)(y) = F(a) and P(D)(y) = Fo(a). Find a particular solution 
for the new forcing function in P(D)(y) = F3. 


7. 


8. 


25 
y”+y'—6y = 50 with y, = —— and y”+y'—6y = 362 with y, = —6a—1; 
Pp 3 Pp 
F(x) = 100 — 18 
1 1 
y” + 2y' + 6y = 2 with yp = = and y” + 2y’ + 6y = e” with y, = 9° 
F(x) = 6 + Ye” 
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1 
9. 4y" + 4y’ +y =e” with yp = —e** and 4y” + 4y' + y = sin 2x + cos 2x 


25 
23 7 
with y, = 599 ©8 Qu 580 sin 2x; F(x) = 13e?” + 2sin 2x + 2cos 2x 
1 
10. y” + 4y' + 5y = cosa with yp = q(sina +cosxz) and y” + 4y’ + 5y = 3x 
-1 3 
with yp = 35 + 523 F(x) = ¢cosx — 2 


11. y"+6y'+25y = e~*” sin 4x with y, = ao cos 4a and y” +6y! +25y = 


1 

—e**; Fy(x) = 8e—5* sin 4a + 5e*” 

65 

In Problems 12-19, find the general solution using 

(a) Method of Undetermined Coefficients or Exponential Response 
(b) Variation of Parameters 


e*? with yp = 


12. y” + 4y' = 2e~* 13. y” — 4y' = cosa 

14. y" + 16y = 2cos 4x 15. y” + 4y’ + 4y =e" 2" 

16. 9y" +y=2 17. 4y” + 25y = 2e-* 

18. y” + 2y' + 17y = e~* cos 4a 19. y” + 3y’ —10y=x+e-* 


In Problems 20-23, find the general solution of the following Cauchy-Euler 
problems. 

20. 227y" + 382y' — y = 3a 21. 22?y"” + 5ay’ +y=x2+3 

22. 427y" + 4ry' +y=2 23. 327y" + 3ay’ + y = 2? 


In Problems 24-25, find the gain and resonant frequency for each of the forced 
oscillators (either a spring-mass system or circuit). Then plot the gain as a 
function of w. 

24. 7” + 62' + 132 = sinwt 25.0" +22’ +172r = 3cosut 
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Chapter 4 Computer Lab: MATLAB 


MATLAB Example 1: Enter the code below to demonstrate, using Sym- 
bolic Math Toolbox, how you obtain the coefficients of a particular solution 
using the method of undetermined coefficients for the ODE 


y + 2y' — 3y = 4e” — sinz 
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= 
= 
= 
= 
= 
= 
= 
=> 
=> 
=> 
=> 
=> 
= 


clear all 

syms x ABC 

eqyp=A*x*exp (x) +B*cos (x)+C*sin(x) 

eqi=diff (eqyp,x,2)+2*diff (eqyp,x)-3*eqyp -4*exp(x)+sin(x) 
The above eqi is the original ode written as lhs-rhs=0, 
wwhere the unwritten ‘=0’ at the end is understood by 
jmatlab. We now type the relationships of the 

Z%coeffs by inspection of the calculated ode eq1 
eq2a=4*A-4 {coefficient of exp(x) 

eq2b=2*C-4*B %coefficient of cos(x) 

eq2c=-4*C-2*B+1 %coefficient of sin(x) 
[A,B,C]=solve(eq2a, eq2b, eq2c) 

yp=subs (eqyp) 


MATLAB Example 2: Enter the code below to demonstrate, using Sym- 


bolic Math Toolbox, how you obtain the coefficients of a particular solution 
using the method of undetermined coefficients for the ODE 


= 
= 
= 
=> 
=> 
= 
= 
= 
= 
= 
= 
> 
= 
=> 
= 
= 
= 
= 
= 


yD +y” = 3x? + 4sinae — 2cosz. 


eli@eie eWLil 

syms x y(x) Al A2 A3 B1 B2 

eqODE=diff (y (x) ,x,4)+diff (y(x) ,x,2)-3+#x’2-4*sin(x)+2*cos (x) 
The above eqODE is the original ode written as lhs-rhs=0, 
d#where the unwritten =0 at the end is understood by MATLAB 
eqyp=A1*x’ 4+A2*x" 3+A3*x 24+B1*x*sin (x) +B2*x*cos (x) 

eqi=subs (eqODE, y (x) , eqyp) 

[c1,t1]=coeffs(eqi,x) 

eq2a=c1(1) %coefficient of x2 

eq2b=c1(2) %coefficient of x 

c1(3) %this does NOT give the constant terms 

Now we need to sub sin(x)=0,cos(x)=0 to get constant terms 
eq2c=subs(c1(3) ,{sin(x) ,cos(x)},{0,0}) %the const terms 
[c2,t2]=coeffs(eq1,cos(x)) 

eq2d=c2(1) {coefficient of cos(x) 
[c3,t3]=coeffs(eq1,sin(x)) 

eq2e=c3(1) %coefficient of sin(x) 
[A1,A2,A3,B1,B2]=solve(eq2a, eq2b,eq2c,eq2d, eq2e) 

yp=subs (eqyp) 


MATLAB Example 3: Enter the code below to demonstrate, using Sym- 


bolic Math Toolbox, how you obtain a particular solution using variation of 
parameters for the ODE 


y —2y' +y=e"lnz, forx>0. 
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= clearsalal 

>> syms x cl c2 

>> yl=exp(x) %The solns yi and y2 are found by hand 
>> y2=x*exp(x) %with yc=cl*y1+c2*y2 
>> G=exp(x)*log (x) 

>> A=ly1,y2; diff(y1,x) ,diff(y2,x)] 
>> W=simplify (det (A)) 

>> ul=int (-y2*G/W,x) 

>> u2=int (y1*G/W,x) 

>> yp=simplify (ul*y1+u2*y2) 

>> gensoln=ci*y1+c2*y2t+yp 


MATLAB Example 4: Enter the code below to demonstrate, using the 
ERF, how to obtain the gain and resonant frequency of Equation (4.67), 


2 
ae ap 2 +u22 = = sin(wt). 
=> clear alll 
>> syms r zeta wn omega FO mt 
>> zeta=sym(’zeta’,’real’) 
>> zeta=sym(’zeta’,’positive’) 
>> wn=sym(wn, ’real’) 
>> wn=sym(wn,’ positive’) 
>> omega=sym(’ omega’, ’real’) 
>> omega=sym(’ omega’, ’ positive’) 
>> F0=sym(FO,’real’) 
>> F0=sym(FO,’ positive’) 
>> m=sym(m, ’real’) 
>> m=sym(n,’positive’) 
>> t=sym(t,’real’) 
>> p(r)=r*2+2*zetaxwnertwn’2 
>> zpsol=(FO/m) *exp(ixomega*t)/p(ixomega) %complex gain 
>> zpsoll=simplify(zpsol*conj(zpsol))/conj(zpsol) 
>> gl=abs(zpsol1l) Z%real gain but not nice looking 
>> ci=imag(zpsol) 
>> c2=real(zpsol) 
>> g=simplify(sqrt(ci%2+c2"2)) Z%also real gain 
>> eqi=diff(g, omega) 
>> solve(eqi, omega) 


MATLAB Exercises 
Turn in both the commands that you enter for the exercises below as well as 


312 Chapter 4. Techniques of Nonhomogeneous Linear Equations 


the output/figures. These should all be in one document. Please highlight or 
clearly indicate all requested answers. Some of the questions will require you 
to modify the above MATLAB code to answer them. 


1. Enter the commands given in MATLAB Example 1 and submit both your 
input and output. 
2. Enter the commands given in MATLAB Example 2 and submit both your 
input and output. 
3. Enter the commands given in MATLAB Example 3 and submit both your 
input and output. 


4. Enter the commands given in MATLAB Example 4 and submit both your 
input and output. 


5. Using the ERF or the method of undetermined coefficients, find a partic- 


ular solution for the ODE y” + 2y/ — 3y = 4e” — sina. 
6. Using the ERF or the method of undetermined coefficients, find a partic- 
ular solution for the ODE y” — 2y’ — 8y = 4e?” — 21e73". 


al 
S 


sing the ERF or the method of undetermined coefficients, find a partic- 
lar solution for the ODE y” — 2y' + 2y = xcosa. 


ge 
Ge 


sing the ERF or the method of undetermined coefficients, find a partic- 
lar solution for the ODE y” — 2y’ + 5y = e® sin 2a. 

sing the ERF or the method of undetermined coefficients, find a partic- 
lar solution for the ODE y” — 2y’ + 5y = 2ae” + e* sin 2x. 

sing the ERF or the method of undetermined coefficients, find a partic- 
lar solution for the ODE y"” + 10y” + 34y’ + 40y = xe~**. 

sing the ERF or the method of undetermined coefficients, find a partic- 
lar solution for the ODE y” + 6y' + 10y = 3xe~3” — 2e®” cos x. 

se es of parameters to find a particular solution for the ODE 


S 


&S 
Sc 


a 
2 
SC 


an 
a 
cue 


an 
a 
ws. © 


~ 1402" 

se variation of parameters to find a particular solution for the ODE 
eo 
a Qy! +y= _ 
6 

se variation of parameters to find a particular solution for the ODE 
/ 

+ y = sec x. 


13. 


1S 


14. 


S 


~ 


< 


15. 


Se 


se variation of parameters to find a particular solution for the ODE 
ii - 2 
+Yy = sin® x. 


~ 


< 


16. Use variation of parameters to find a particular solution for the ODE 
ay” + 6ary"” =1, « > 0 with fundamental set of solutions {1, 1/2, x}. 


se variation of parameters to find a particular solution for the ODE 


Na 


17. 


<6 


1 il 1 

“4 — y' + — y = —, « > 0 with fundamental set of solutions 
r x r 

{sin(In x), cos(In x) }. 


18. 


il), 


20. 
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Consider the equation mx” + bx’ + kx = Fo coswt, which models a forced 
mass on a spring. Use the ERF or method of undetermined coefficients 
to derive a formula for the gain and the resonant frequency. 


Consider the equation ma” + ba’ + ka = by’ with forcing y = Fo coswt, 
which models a forced mass on a spring. Use the ERF or method of un- 
determined coefficients to derive a formula for the gain and the resonant 
frequency. 

Consider the equation mx” + ba’ + kx = by! + ky with forcing y = 
Fo coswt, which models a forced mass on a spring. Use the ERF or 
method of undetermined coefficients to derive a formula for the gain and 


the resonant frequency. 


Chapter 4 Computer Lab: Maple 


Maple Example 1: Enter the code below to demonstrate how you obtain 


the coefficients of a particular solution using the method of undetermined 


coefficients for the ODE 
y + 2y' — 3y = 4e” — sing 


restart 
yp := 2% A-x-e* + B-cos(x) + C- sin(x) 
eqODE := y??(x) +2-y?(a) —3-y(x) =4-e” —sin(z) 
eql := expand(subs(y(x) = yp(a), eqODE)) 
#We need to inspect the powers of like terms and 
write down the expressions involving A,B,C. 
eq2a := subs(e* = 1, cos(a) = 0, sin(a) = 0, eq1) #coeff of exp 
eq2b := subs(e” = 0, cos(x) = 1, sin(a) = 0, eq1) #coeff of cos 
eq2c := subs(e” = 0, cos(x) = 0, sin(x) = 1, eq1) # coeff of sin 
eg3 := solve({ eq2a, eq2b, eq2c}, { A, B, C}) 
eg4 := Yp = subs(eg3, yp(x)) 


Maple Example 2: Enter the code below to demonstrate how you obtain 
the coefficients of a particular solution using the method of undetermined 


coefficients for the ODE 
yD + y" = 3a? + Asin x — 2cosz. 


restart 
eqODE := y“ (x) + y??(z) = 3-2? +4- sin(x) — 2- cos(x) 
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eqyp := A, -a* + Ap- a? + Az: 27+ B,- x -sin(x) + Bo- x: cos(z) 

eq1 := expand(subs(y(a) = eqyp, eqODE)) 

eq2a := coeff( ths(eq1), cos(x)) = coeff(rhs(eq1), cos(x)) 

eq2b := coeff(lhs(eq1), sin(x)) = coeff(rhs(eq1), sin(a)) 

eq2c := coeff(rhs(eq1), x, 2) # this should give you an error because Maple 
won't compute a coeff of a power of x with cos(x) and sin(x) still 
in the expression. We now get rid of cos(a) and sin(x) in eq3: 

eq3 := subs(cos(a) = 0, sin(x) = 0, eg1) 

eqa := coeff(lhs(eq3), x, 2) = coeff(rhs(eq3), x, 2) 

eq3b := coeff(lhs(eq3), x, 1) = coeff(rhs(eq3), x, 1) 

eq3c := coeff(lhs(eq3), x, 0) = coeff(rhs(eq3), x, 0) 

soln := solve ({ eq2a, eq2b, eg3a, eq3b, eg3c}, { Ai, Ao, As, Bi, B2}) 

eg4 = Yp = subs(soln, eqyp) 


Maple Example 3: Enter the code below to demonstrate how you obtain a 
particular solution using variation of parameters for the ODE 


y —22y +y=e"lnz, forx>O0. 


restart 

gil =e" 
y2:=@-e” 

G :=e” - In(z) 


with(LinearAlgebra) : with( VectorCalculus) : 
W := Wronskian((y1, y2|, x, determinant’) 
Wi] 
numer1 := Matrix(([0, y2],[G, y2’]]) 
numer2 := Matrix({[y1, 0], [y1’, G]]) 

ee | Determinant(numer1) 
ol = 7p) 

ee Determinant(numer2) 
uo := / a 
Yp = simplify(ul- y1+ u2- y2) 


dx 


Maple Example 4: Enter the code below to demonstrate, using the ERF, 
how to obtain the gain and resonant frequency of Equation (4.67), 
Cx 2 


dx Po 
WP + 2Cwn ae Oe = = sin(wt). 


restart 
p:=r?+2-zeta-wy-r+w? # type zeta, don’t use symbol from palette 


Fi 
(=) F elwt 
m 


subs(r = I- w,p) 


zpsol := #complex gain 


Chapter 4 Computer Labs 315 


abs(zpsol) 

evalc( abs(zpsol)) 

g := simplify(evalc( abs(zpsol)))#real gain 
gprime := diff(g, w) 

Wres = solve(gprime, w) 


Maple Exercises 

Turn in both the commands that you enter for the exercises below as well as 
the output/figures. These should all be in one document. Please highlight or 
clearly indicate all requested answers. Some of the questions will require you 
to modify the above Maple code to answer them. 


IL, 


13. 


Enter the commands given in Maple Example 1 and submit both your 
input and output. 


. Enter the commands given in Maple Example 2 and submit both your 


input and output. 


. Enter the commands given in Maple Example 3 and submit both your 


input and output. 


. Enter the commands given in Maple Example 4 and submit both your 


input and output. 


. Using the ERF or the method of undetermined coefficients, find a partic- 


lar solution for the ODE y” + 2y’ — 3y = 4e” — sing. 

sing the ERF or the method of undetermined coefficients, find a partic- 
lar solution for the ODE y” — 2y’ — 8y = 4c? — 21e7°*. 

sing the ERF or the method of undetermined coefficients, find a partic- 
lar solution for the ODE y” — 2y’ + 2y = xcosa. 

sing the ERF or the method of undetermined coefficients, find a partic- 
lar solution for the ODE y” — 2y’ + 5y = e” sin 2a. 

sing the ERF or the method of undetermined coefficients, find a partic- 
lar solution for the ODE y” — 2y’ + 5y = 2xe” + e” sin 2a. 

sing the ERF or the method of undetermined coefficients, find a partic- 
lar solution for the ODE y'” + 10y” + 34y’ + 40y = re~**. 

sing the ERF or the method of undetermined coefficients, find a partic- 
lar solution for the ODE y” + 6y’ + 10y = 3xe—3* — 2e3 cos x. 


se variation of parameters to find a particular solution for the ODE 
1 
I 


Gs eseiesee seeds 


Geese 


~ 


~ 14a?" 
se variation of parameters to find a particular solution for the ODE 
x 


je 


(e 
” p = 


< 
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14. Use variation of parameters to find a particular solution for the ODE 
yo +y =seca. 
15. Use variation of parameters to find a particular solution for the ODE 
yf + y =sin’ gz. 


16. Use variation of parameters to find a particular solution for the ODE 
Qx7y'" + 6ay” =1, « > 0 with fundamental set of solutions {1, 1/2, x}. 


17. Use variation of parameters to find a particular solution for the ODE 


il 1 il 
y toy t+ => ¥ = =, & > O with fundamental set of solutions 
iG 


{sin(In x), cos(In x) }. 
18. Consider the equation mx” + ba’ +ka = Fo coswt, which models a forced 


mass on a spring. Use the ERF or method of undetermined coefficients 
to derive a formula for the gain and the resonant frequency. 


19. Consider the equation max” + ba’ + ka = by’ with forcing y = Fo coswt, 
which models a forced mass on a spring. Use the ERF or method of un- 
determined coefficients to derive a formula for the gain and the resonant 
frequency. 

20. Consider the equation ma” + ba’ + ka = by’ + ky with forcing y = 
Fo coswt, which models a forced mass on a spring. Use the ERF or 
method of undetermined coefficients to derive a formula for the gain and 
the resonant frequency. 


Chapter 4 Computer Lab: Mathematica 


Mathematica Example 1: Enter the code below to demonstrate how you 
obtain the coefficients of a particular solution using the method of undeter- 
mined coefficients for the ODE 


y + 2y’ — 3y = 4e” — sine 


Quit| |] 
yp[x_] = Axe* + BCos[x] + C1iSin[x] (* <space> for mult. *) 
(*Mathematica uses C for naming constants so we use C1*) 
eleyyiee_]] = yw? ? |bsl] s Ay? [bell = Syyleell = Bee sh Srim|be] 
lhs = Simplify[ReplaceAll[dey[x], y—yp]] 
(*Inspect like terms to get coefficients*) 
eqi = Coefficient[lhs, e*] 


eq2 
eq3 
sol 
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Coefficient[lhs, Cos[x]] 
Coefficient[lhs, Sin[x]] 


Solve[{eq1==0, eq2==0, eq3==0}, {A, B, C1}] 


ReplaceAlllyp[x], sol] 
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Mathematica Example 2: Enter the code below to demonstrate how you 


obtain the coefficients of a particular solution using the method of undeter- 
mined coefficients for the ODE 


Quit|] 


yp[x_] = A1lx* + A2x® + A3x? + B1xSin[x] + B2xCos[x] 
dey[x_] = y’??? [x] + y’’ [x] - 3x? - 4Sin[x] + 2Cos[x] 


y + y"” = 3a? + 4sin ax — 2cosz. 


lhs = ReplaceAll[dey[x], y—yp] 


(need to get constant term, not with Cos[x] and Sin[x]*) 


eqi = Coefficient[ReplaceAll[lhs, {Cos[x]0, Sin[x]—0}], x, 0] 
(*eql is the constant term*) 
Coefficient[lhs, x] 
Coefficient[lhs, x, 2] 
Coefficient[lhs, Cos[x]] 
Coefficient[lhs, Sin[x]] 


eq2 
eq3 
eq4 
eqs 


sol = Solve[{eq1==0, eq2==0, eq3==0, eq4==0 eq5==0}, 


(hie ho Ao, Bie Boh) 
ReplaceAlllyp[x], sol] 


Mathematica Example 3: Enter the code below to demonstrate how you 


obtain a particular solution using variation of parameters for the ODE 


Quit|] 
yilx_] = e 
y2[x_] = xe* 
G[x_] 


wil 


u2 


y’ —2y’+y=e lng, 


= e*Log[x] (*rhs of ODE*) 
W = Wronskian[{y1il[x], y2[x]}, x] 
numer1 = Det [{{0, y2[x]}, {Glx], y2’[x]}}] 
numer2 = Det[{{y1il[x], 0}, {y1’[x], Glx]}}] 


numert 
i ax 
W 


2 
ii numer a 
W 


x 


igie 4@ S> (0) 
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yp = ulyi[x] + u2y2[x] 


Mathematica Example 4: Enter the code below to demonstrate, using the 
ERF, how to obtain the gain and resonant frequency of Equation (4.67), 


d?x dx 5 Ly 
WE sf 2CWn Ge +weig = os sin(wt). 
Quit| | 
plr_] = r? + 2zetawnr + wn? 
FO ei wt 
zpsol = 7 


ReplaceAl1[p[r],r>iw] 

Abs [zpsol] 

glw_] = ComplexExpand [Abs [zpsol] ] 
gprime = g’ [w] 

wres = Solve[gprime==0, w] 


Mathematica Exercises 

Turn in both the commands that you enter for the exercises below as well as 
the output/figures. These should all be in one document. Please highlight or 
clearly indicate all requested answers. Some of the questions will require you 
to modify the above Mathematica code to answer them. 


1. Enter the commands given in Mathematica Example 1 and submit both 
your input and output. 

2. Enter the commands given in Mathematica Example 2 and submit both 
your input and output. 

3. Enter the commands given in Mathematica Example 3 and submit both 
your input and output. 

4. Enter the commands given in Mathematica Example 4 and submit both 
your input and output. 

5. Using the ERF or the method of undetermined coefficients, find a partic- 

ular solution for the ODE y” + 2y/ — 3y = 4e” — sina. 

6. Using the ERF or the method of undetermined coefficients, find a partic- 

ular solution for the ODE y” — 2y’ — 8y = 4e2” — 21e73*. 

7. Using the ERF or the method of undetermined coefficients, find a partic- 

ular solution for the ODE y” — 2y/ + 2y = xcosa. 

8. Using the ERF or the method of undetermined coefficients, find a partic- 

ular solution for the ODE y” — 2y/ + 5y = e* sin 2a. 

9. Using the ERF or the method of undetermined coefficients, find a partic- 
ular solution for the ODE y” — 2y/ + 5y = 2xe* + e* sin 2a. 


10. 


iil, 


12, 


i133, 


14. 


15. 


16. 


fe 


18. 


il), 


20. 
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Using the ERF or the method of undetermined coefficients, find a partic- 

ular solution for the ODE y’” + 10y” + 34y’ + 40y = xe~*”. 

Using the ERF or the method of undetermined coefficients, find a partic- 

ular solution for the ODE y” + 6y’ + 10y = 32e~3* — 2e%* cos x. 

Use variation of parameters to find a particular solution for the ODE 

P 

YS eae 

Use variation of parameters to find a particular solution for the ODE 
ee 

LY) i 

ae 

Use variation of parameters to find a particular solution for the ODE 

y” +y =seca. 


~ 


Use variation of parameters to find a particular solution for the ODE 
y” +y =sin’ z. 

Use variation of parameters to find a particular solution for the ODE 
2x7y" + 6ry" = 1, x > 0 with fundamental set of solutions {1,1/z, x}. 


Use variation of parameters to find a particular solution for the ODE 
y” + a y + oe = - x > 0 with fundamental set of solutions 
{sin(In x), cos(In z)}. 

Consider the equation ma” + bx’ +ka = Fo coswt, which models a forced 
mass on a spring. Use the ERF or method of undetermined coefficients 


to derive a formula for the gain and the resonant frequency. 


Consider the equation max” + ba’ + ka = by’ with forcing y = Fo coswt, 
which models a forced mass on a spring. Use the ERF or method of un- 
determined coefficients to derive a formula for the gain and the resonant 
frequency. 

Consider the equation ma” + ba’ + ka = by! + ky with forcing y = 
Fo coswt, which models a forced mass on a spring. Use the ERF or 
method of undetermined coefficients to derive a formula for the gain and 
the resonant frequency. 
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Chapter 4 Projects 


Project 4A: Forced Duffing Equation [26], [48] 


One formulation of the forced Duffing equation is 
x” + ba’ + ka + 62? = Fy sin(wt), (4.87) 


where x = x(t). When 6 = 0, the equation reduces to that of the forced 
mass on a spring of Section 4.7. Thus we can think of the left-hand side 
of Equation (4.87) as describing a nonlinear spring with attached mass 
m = 1. Let’s take k = 6 = 1, for simplicity, and see what this means. 
For small x-values, i.e., the mass on the spring is not too far from rest 
position, the 2° term is probably negligible and we can approximate the 
solution by dropping this term. However, for moderate or large x-values 
we cannot neglect this term. 

(1) The restoring force, F = ka + dx, is nonlinear. Give a physical 
interpretation of this term. For example, is the restoring force greater 
for small x or large 7? What physical implications does this have? 

(2) Set k = 6 =1, Fo = 0, b= 0.2. Using MATLAB, Maple, or Math- 
ematica with h = 0.01, let x’(0) = 1.0 and begin with the five different 
initial conditions x(0) = 0,0.5, 1.0, 3.0, 4.0 to plot five different solutions 
in the t-z plane. What are the transient and long-term behaviors of the 
solution? Numerically solve the equation to at least t = 100. 

(3) Now we will observe what happens as we force this nonlinear oscilla- 
tor by changing Fo and w. Still keeping k = 6 = 1, b = 0.2, set w =1 
and plot solutions for Fy = .1, .5, 2, 10, 15, 20, 25, 30. Use the initial 
condition «(0) = 2, «’(0) = 1. What are the transient and long-term 
behaviors of each solution? Comment on any difference observed in the 
plots. 

(4) Repeat the above step but now numerically solve Duffing’s equation 
using the initial condition x(0) = 1, x'(0) = 2. What are the transient 
and long-term behaviors of each solution? Comment on any difference 
observed in the plots, both in this part and when compared with those 
of Part 3. 

(5) Now fix Fo = 25 (with k = 6 = 1, b = .2) and vary w. Choose 
the values w = .1, .2, .5, .8, 1, 1.2, 1.5, 2.0, 5.0, and others, if you so 
desire. What are the transient and long-term behaviors of each solution? 
Comment on any difference observed in the pictures. 

What effect does the nonlinearity and forcing have on the motion x(t)? 
Is it predictable? 
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Project 4B: Forced van der Pol Oscillator [27], [48] 


One formulation of the forced van der Pol equation is 
a” + ex'(z? —1) +a = Fosin(wt), (4.88) 


where « = a(t), e € R. This was originally considered as an electric 
circuit with a triode and later as an electric circuit with a tunnel diode. 
We can think of x as a dimensionless voltage. When ¢ = 0, the equation 
reduces to that of the forced LC circuit of Section 4.7. Thus we can think 
of the left-hand side of Equation (4.88) as describing an RLC circuit with 
nonlinear resistance. Let’s take e = 1, for simplicity, and see what this 
means. For large z-values, the coefficient of x’(t) is positive and we would 
expect damping to occur. However, for small values of x, the coefficient of 
u'(t) is negative and thus small oscillations are amplified (not damped). 
(1) The equation of the electric circuit tunnel diode is given as 


a — 3yV? 1 


/ = 
a toeV =o (4.89) 


We" 


where V is the voltage, C the capacitance, L the inductance, and a,¥ 
are parameters [46]. Derive the unforced van der Pol oscillator by nondi- 


mensionalizing (4.89). Show that « = /2V, — ret. C= i ee are 
the required substitutions. 

(2) Sete =1, Fo = 0, b= 0.2. Using MATLAB, Maple, or Mathematica 
with h = 0.01, let «’(0) = 1.0 and begin with the five different initial 
conditions «(0) = 0, 0.5, 1.0, 3.0, 4.0 to plot five different solutions in the 
t-x plane. What are the transient and long-term behaviors of the solu- 
tion? Numerically solve the equation to at least t = 100. 

(3) Now we will observe what happens as we force this nonlinear oscilla- 
tor by changing Fo and w. Still keeping « = 1, b = 0.2, set w = 1 and plot 
solutions for Fo = .1, .5, 2, 10, 15, 20, 25, 30. Use the initial condition 
x(0) = 2, x’(0) = 1. What are the transient and long-term behaviors of 
each solution? Comment on any difference observed in the plots. 

(4) Repeat the above step but now numerically solve van der Pol’s equa- 
tion using the initial condition (0) = 1, 2'(0) = 2. What are the 
transient and long-term behaviors of each solution? Comment on any 
difference observed in the plots, both in this part and when compared 
with those of Part 3. 

(5) Now fix Fo = 25 (with e = 1, b =.2) and vary w. Choose the values 
w=.1, .2, .5, .8, 1, 1.2, 1.5, 2.0, 5.0 and others, if you so desire. What 
are the transient and long-term behaviors of each solution? Comment on 
any difference observed in the pictures. 

What effect does the nonlinearity and forcing have on the motion x(t)? 
Is it predictable? 
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Chapter 5 


Fundamentals of Systems of 
Differential Equations 


Earlier we briefly considered systems of equations when converting an nth- 
order equation to a system of n first-order equations. But systems of differ- 
ential equations arise in their own right—-whenever there is more than one 
dependent variable for an independent variable. For example, one might con- 
sider a system with two or more interacting species with the population sizes 
changing over time. The most common of these are known as Lotka- Volterra 
models and are discussed in detail in Section 6.5. One of these models is a 
predator—prey system in which the prey population growth depends upon 
the number of predators that kill the prey. Similarly, the rate at which the 
predator population grows depends on the size of their food supply, namely, 
the prey population. In general, these conditions produce nonlinear equa- 
tions that are very difficult to solve analytically. This is just one scenario we 
can consider. In this chapter, we discuss methods for solving these types of 
systems. 


The objects of study of the first few sections of this chapter are linear 
systems of equations, which are differential equations of the form 


“4 = aii (t)a1 + ai2(t)to +--+ + ain(t)tn + filt) 

“2 = ag1(t)%1 + age(t)e2 + +++ + Gan(t)tn + fa(t) (5.1) 
die 

dt = Ani (t) xy Tv An2(t)x2 sli 2 Ann(t) En a In(t); 


where the variables x;, f; and coefficients a;; are all functions of t. The sit- 
uation when an nth-order system is derived from an nth-order equation is 
simply a special case. In the event that the coefficients a;; are constant and 
the f; are zero, we refer to system (5.1) as an autonomous system of n first- 
order equations and there are special techniques that will apply. System (5.1) 
has aspects of matrix analysis, so that at this point, the reader is strongly 
encouraged to review the material in Appendix B.1 before proceeding. 
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5.1 Useful Terminology 


Many of the terms that we are about to encounter have arisen at earlier 
points in this book. The significance here is that they apply to a system of 
equations as well. We consider (5.1) written in matrix notation: 


oS 
- ayi(t) aio(t) +++ ain(é)] faa fi(t) 
Fa fm me mo] a] 1H] gy 
ee Ani (t) an2 (t) ae Ann (t) In fn (t) 
dt 
or, more compactly, simply as 
dx 
Ta Ax+F, (5.3) 


where x, A, F are possibly all functions of t and A is known as the coefficient 
matrix. If F(t) = 0, we say that the system is homogeneous and write it as 
dx 
— = Ax. 5.4 
HT AX (5.4) 
Before continuing, we formally address the notion of the derivative of a 
matrix. 


Definition 5.1.1 
The derivative of the m x n matrix A(t) = [a;;(t)], whose elements a,,(t) 
are differentiable on some interval J, is defined by taking the derivative 
of each component: 

dA = ca 


de dt 


The integral of the m x n matrix A(t) = [a;;(t)], whose elements aj; (t) 
are continuous on some interval J, is defined by taking the integral of 


each component: 
t iD 
i N= / ai; (Ss) as : 
to to 


| Example 1, Consider the matrix 


A=|) 0 oa 
e€ 
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Find the derivative of A. Then find the integral of A (from 0 to ft). 


Solution 
To find the derivative, we differentiate componentwise. Thus 


aR | “ (1) “ (0) “ (sin t) ] 0 0 | 
‘dt | d ot d d 2 i. 2e7* -—1 6 , 
a) 4c) Ze | 


For the integral, we similarly integrate componentwise. We note that we use 
the dummy variable s to do this integration: 


t t t 
t | 1 ds | 0 ds | sins ds 
fa=|2 2 
: | e7* ds i —s ds 7 (3s? — 4) ds 
0 0 0 


t 0 1—cost 


1 1 -t 
gt t3 — At 
fh 7 3 a 


Using this idea, some of our previous work can be extended. For example, if 
the components of a vector x are differentiable on an open interval (a,b) and 
satisfy the system of differential equations, then we say that x is a solution of 
(5.2). 


| Example 2 | Verify that the vectors 


t 


1 
—2t x,=1]0/e, and x3=1|10| e* 
1 


0 
X1=]0]/e 
1 
are each a solution to the system 
dx 1 1 
ae where A=|0 3 O 
3 0 -2 
Solution 


This is done by substitution of each vector into the differential equation: 


0 1 1 0 0 
——=]|0| (-2e°*) andAxi=|0 3 0 CLe oc = | oer 
1 3.0 -2 1 
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dxy : t ae ; t : t 
P= [0] () and Ax2=|0 3 0 | Jofe'= Jo] et 
1 3 0 —-2 1 1 
ee 5 : 1 1 O 5 15 7 
ae = 1.10 (3e ) and Ax3 = 1-0) 0 10 | e = | 380] e. 
3 3 0 -2 3 9 


In each case, we see that the vector x; satisfies the differential equation for 


all t and thus is a solution for all t. - 


As we have seen, it is straightforward to check if a given vector is a solution. 
Just as we have done in previous chapters, it is useful to know when we can 
actually expect to have a solution. Because we are currently considering a 
linear system of equations, the following theorems are an asset. 


THEOREM 5.1.1 Existence and Uniqueness 


Consider the initial-value problem for the system 


dx 

ne Ax+F, x(to) =Xo, (5.5) 
where A(t) is an m Xx n matrix and F(t) is an m-component vector of 
continuous real functions on the interval a < t < b. If tg is any point in 
the interval [a,b], then there exists a unique solution to (5.5) and this 
solution is defined over the entire interval a < t < b. 


For the homogeneous case (5.4), we can consider linear combinations of 
these solutions. 


THEOREM 5.1.2 
Let x1,X2,--: ,x, be any & solutions of the homogeneous system x’ = 
A(t)x. Then 

GAG =P Gea Se 8 oo ae Cede 


is also a solution of the homogeneous system, where cj, ¢2,::: ,CcK are 
arbitrary constants. 


| Example 3 | In Example 2, we showed the vectors 


—2t t 


1 
, X2=|0]e’, and x3=1]10] e* 
1 


0 
x1 = {Ole 
il 3 
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are each a solution of the system 


dx i 
—=Ax, where A=]Q0 
dt 3 


GoW rR 
j=) 


According to Theorem 5.1.2, we have that 


coe’ + c35e%* 
x(t) = c1X1 + C2X2 + ¢3x3 = c310e%" 
cye7 7 + coe’ + c330e%* 


is also a solution of x’ = Ax. To see this, we first take the derivative of this 
linear combination to get 


cge! + c315€%" 
x(t) = c330e*" 


c1(—2)e—7* + eget + c39e* 


We also evaluate the right-hand side, Ax(t), to get 


1 1 0 cge’ + c35e%" coe’ + c315e%* 
03 #0 c310e%# = c330e7" 
3 0 -2 cye7 2! + coet + c336%* c1(—2)e—7! + coe’ + c39e%* 


The equality of the results of these two calculations shows that c,x + c2x2 + 


c3X3 is indeed a solution. = 


In Section 3.2, we considered the above theorems for the case of functions 
and not vectors. We wanted to write the general solution and we needed to 
know when functions were linearly independent. We can formulate a similar 
definition for vectors. 


Definition 5.1.2 
The k functions x), X2,--- ,x, are linearly dependent on a <t < Dif 
there exist constants ¢,,C2,°-- ,¢x, not all zero, such that 


C1X1 +coXo +---+cpx, = 0 


for all ¢ in the interval (a,b). We say that the k functions x1, x2,--- , Xx 
are linearly independent on a < t < 6 if they are not linearly depen- 
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dent there. That is, x;,X2,--: ,X, are linearly independent ona <t<b 
if 
CX + coXg +---+cpx, = 0 
for all ¢ in (a,b) implies c, = co =... = cy, = 0. 
| Example 4| — The vectors 
et et 3e! — 2e~7# 
X= 10); xe=]e 7], x= —2e~7* 
ef 0 3e! 


are linearly dependent because 


3X1 = 2X9 —xX3 >= 0. 


ea) 
| Example 5 The vectors 
0 1 1 
xX,=]0/e', x.=]0|e°, and x3= | 2] e* 
1 1 3 


are linearly independent because if 


0 et et C1 0 
(1X1 teoxote3x= 10 OO Qe] le} =]0 
ef e* B3e%* |] | cg 0 


for all x, then we can solve this equation for the c; since our matrix is in- 
vertible to obtain cj = cg = cs = 0. (We could have solved this by Cramer’s 
rule (determinant is not zero), Gaussian elimination, or any other method to 


obtain this conclusion, too.) ‘a 


With this concept of linear independence in place, we can state an extremely 
useful theorem. 


THEOREM 5.1.3 

The homogeneous system (5.4) always possesses n solution vectors that 
are linearly independent. Further, if x,,x2,...,X, are n linearly inde- 
pendent solutions of (5.4), then every solution x of (5.4) can be expressed 
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as a linear combination 
Cy xX (t) =F C2X9(t) SP coe a Caesa (t) (5.6) 


of these n linearly independent solutions by proper choice of the constants 
C1,C€2,-+-,Cn. Expression (5.6) is called the general solution of (5.4) 
and is defined on (a,b), the interval on which solutions exist and are 
unique. 


We thus have that the solutions x;,...,x,, can be combined to give us any 


solution we desire. As before, the concept of a fundamental set of solu- 
tions gives us the set necessary to write the general solution. 


Three Necessary and Sufficient Conditions for a Fundamental 
Set of Solutions of (5.4) 


1. The number of vectors (elements) in this set must be the same as 
the number of first-order ODEs in system (5.4). 


2. Each vector x; in this set must be a solution to system (5.4). 
3. The vectors must be linearly independent. 


As before, we note that a fundamental set of solutions is not unique. Once 
we have a fundamental set of solutions, we can construct all possible solutions 
from it. 

Testing for linear independence is usually the challenging part and we can 
use a familiar tool to help us. 


Definition 5.1.3 


Let 
x11 (E) x12(t) Lin(E) 
gon x21 (t) eae 022 (t) eae Lan (t) 
tna (t) tna(t) tnn(t) 


be n real vector functions of t. The determinant 


x11 (t) X12(t) Caer Lin (Et) 
x1 (t) x29(t) eo.G Lan (Et) 


ec eee 


is called the Wronskian. 


330 Chapter 5. Fundamentals of Systems of Differential Eqns 


THEOREM 5.1.4 

Let x1, X2,...,X»n be defined as in Definition 5.1.3. 

1. If W(to) £0 for some to € (a, 6), then it follows that x,,x2,...,Xn 
are linearly independent on (a, 0). 

2. If x1,X2,...,Xn are linearly dependent on (a,b), then W(t) = 0, for 
all t € (a,b). 


THEOREM 5.1.5 

Let x1,X2,...,Xp be defined as in Definition 5.1.3. Suppose that the x; 
are each a solution of (5.4). Then exactly one of the following statements 
is true: 

1. W(t) 40, for all t € (a,b) 

2. W(t) =0, for all t € (a, 6) 

Moreover, W(t) # 0 for all t € (a,b) if and only if the {x;} are linearly 
independent on (a,b). Similarly, W(t) = 0 for all t € (a,b) if and only if 
the {x;} are linearly dependent on (a, b). 


NOE The vectors 
5 


0 1 
x,;= |0 em. xXo=]O0/}e’, and x3=]10 et 
1 1 3 


are linearly independent because 
) ve* Gee 


0 10e% 0 10e** 0 0 
0 = ; i = 0- et 3¢3t =e en 2t  3e3t +58.) a gi 
Ee e” 3¢€ 
= —e'(—10e*%e-*") = 10e”, (a7) 


which is never zero. 
o 

All of the theory so far has given us the necessary information to state a 
theorem for the nonhomogeneous linear system (5.2). 


THEOREM 5.1.6 


Let x, be a solution of the nonhomogeneous system (5.2). Let 
Xe = €1X1 + XoXo +... +CnXn 


be the general solution of the corresponding homogeneous equation (5.4). 
Then every solution ® of the nonhomogeneous system (5.2) can be ex- 
pressed in the form 

=x, + Xp. 


5.1. Useful Terminology 331 


Just as with Theorem 4.1.2 for our nth-order equations, we have a theorem 
that says we only ever need to find a single particular solution because any 
other particular solution is a linear combination of the fundamental set of 
solutions for the homogeneous equation plus the particular solution. 


THEOREM 5.1.7 
Let x, and X be two solutions of the nonhomogeneous equation x’ = 
Ax + F where A is n x n. Then 


D6 = 10 I Cie) Se OP SP on 0 ap Ege. Gan 


where xX1,...,X», is a fundamental set of solutions for x’ = Ax. 
e e e e e e e e e e e e 
Problems 


In Problems 1-8, find the derivative and antiderivative of each matrix. 


j sint ef cos?t te? 
“| 4% 3t 


0 3t+1 
cost e% e** cost te! 
fi 0 3 In|¢| | 
sint _te~* et cost e—%! et 
5. | 0 0 ae” G..|) a 0 2te# 
ef t?+e-* cost et et Q- 
e-'sint —e% e—% tant 2+e§ et 
i vt t* cost 8.| 0 t+vt 2e% 
4/3 0 te et 3+e' cost 


In Problems 9-15, verify that given vectors are solutions to the equation 
dx 
co” = Ax. 


9.x, = [=| et, x= | e, A= E = 

10. x; = E e', x9= 2 et A= E | 

11.x,; = 5 e xy = E ec A= E =| 

12.x,; = | e*!, xy = Fil e, A= bi | 
1 0 —1 1 O -1 

13.x, = | 0} efx. =]1]e',x,=] 0 |e, A=|10 -1 O 
0 0 1 0 0 2 
1 0 1 —2 2 O 

14, x; = |2| e*,% = 10) e2,x%3=|/-1|)e*",A=)| 4 0 O 
0 1 1 = 2 
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i —l 1 1 1 0 
15.x,; = |—-3] e-7,x. = | 2 |e*,x3=] 0 |e’, A=] 6 2 6 
i 0 —1 -6 -3 -5 


16. If x1,x2 are both solutions to x’ = Ax, show that cyx + c2X2 is also a 
solution. 


In Problems 17-24, classify the following sets of vectors as linearly dependent 
or linearly independent. 


eile file} {GBD 
»{{3]. [2] tal La]es) 


1 0 
2 es | 
0 3 

3 =3 0 3 =] 0 

23.4 141) ete Ole 24.4 )=3|,.| £1,108 
0 0 1 0 iL 1 


In Problems 25-30, determine if the following set forms a fundamental set of 
solutions for the given differential equation. 


25.1 fxcoun) [sean | X= [22 3] 
lee he ele 


5t t 
{lS |b falp = [5 3']* 
et det ie 2 
{| [0 I} =o 7a) 
1 =i 0 1 
0.5 Ole.) 1 be Ole" >, a=l\0 —1 O |x 
0 0 1 0 0 -2 
0 1 =| i 3 0 
30. O}e*,|0le,) 1 |e*>, x =|0 -1 O |x 
1 3 -1 1 0 -2 


5.2 Gaussian Elimination 


We will give a little bit of “machinery” that will allow us to quickly solve 
systems of linear equations. Why? In Section 5.4, we will solve a system in 
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the form 
Ax =0 


in order to help us solve the ODE system x’ = Ax. For nonhomogeneous 
constant coefficient equations in which the forcing function is constant, we 
will need to solve a system in the form 


Ax=b 


in order to obtain the particular solution. Both of these equations can be 
solved via Gaussian elimination and we often just consider the second since 
the first is simply obtained when b = O. We assume the reader is familiar 
with Section B.1 of Appendix B in which some of the basics of matrices are 
covered. We finished that section with an equivalency theorem: 


THEOREM 5.2.1 

The following are equivalent characterizations of the n x n matrix A: 
(a) A is invertible. 

(b) The system Ax = b has a unique solution x for all b in R”. 

(c) The system Ax = 0 has x = 0 as its unique solution. 
(d) det(A) 4 0. 
(e) The n columns of A are linearly independent. 


We will add to this list in this section. 


In the simplest case, our matrix A will be diagonal: 


a; 0. ex O 
O: ae «% 
A=]. ; 
; 0 e 3 
GO @. sts <a 


We could then solve Ax = b by simply dividing the entry b; of b by d; for 
each 7. However, we will usually not be so lucky. To solve a more general 
Ax = b by hand, we begin with an example. 


|Example 1:| Solve the given equations simultaneously by using multiples of 


each equation to reduce the system: 


—2a +427 =2 (eq1) 
4x +2y—4z=-2  (eq2) 
2a +4y+2z=-2 (eq3) (5.8) 


to a solvable form. 


Solution 
We want to systematically add and subtract equations from each other to 
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achieve this. It is extremely important to remember that multiplying both 
sides of an equation by a (non-zero) number does not change the solution 
just as adding two equations together does not change the solution either. 
Thus performing the operations below gives us a simpler system with the 
same solution set as the original system. We will proceed by first making two 
entries in the same column equal and then subtracting the rows. 

Let us fix the first equation and subtract multiples of it from the other two 
to try to eliminate x. If we multiply —2 times the first equation and subtract 
it from the second, we will eliminate the x variable in that equation. Likewise, 
if we multiply —1 times the first equation and subtract it from the third, we 
will eliminate the x from the third equation. Doing so gives 


—24+4z=2 (5.9) 
2y+4z2=2 (eq2 — (—2eq1) > eq2a) (5.10) 
4y+6z=0. (eq3 — (—eql1) > eq3a) (5.11) 


If we now combine the new second and third equations in a similar way, we 
will obtain a form that we can easily solve. Thus we multiply the new second 
equation (eq2a) times 2 and subtract it from the new third equation (eq3a) 
and put it in the place of this last equation (now call it eq3b): 


In +42 =2 (5.12) 
2yt+4z=2 (5.13) 
—2z=—-4.  (eq8a — 2eq2a — eq3b) (5.14) 


We now use back substitution to solve the system, starting with the last 
row and working our way up. Solving the last equation gives us z = 2. We 
substitute this into the second equation and then see that y = —3. Substitut- 


ing into the first equation gives x = 3. = 


We want to reexamine this last example, but now from the point of view of 
matrices and vectors. We consider the coefficient matrix with the right-hand 
side of (5.8) given as an additional column on the right. The resulting matrix 
is called the augmented matrix: 


0 42 2 
4 2 =4° =9). (5.15) 
, 4.90 29 


We then proceed to reduce the augmented matrix, just as we did with the 
system of equations. We let R,, Ro, R3 denote rows 1, 2, and 3, respectively, 
of our augmented matrix. We will use the notation 2R; — (—R2) > Rez to 
mean that we multiply row 2 by —1, subtract it from 2 times row 2, and 
then put the result in row 2 and this new row 2 will now be called Rz. Then 
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beginning with (5.15) 


—2 04 2 

R2 — (—2R1) > Re gives 024 24], (5.16) 
2 42 -2 
—2 0 4 2 

R3 —(—R,) > R3 gives 0 24 2]. (5.17) 
0 4 6 0 


We note that the (1,1) entry of the augmented matrix (—2 in this case) needed 
to be nonzero in order to eliminate the entries in the same column that lie 
below it. We call —2 a pivot and observe that we will always need to have a 
non-zero pivot in order to proceed. In the event that we obtain a 0 for a pivot 
element, we may interchange rows if it will help us proceed; if not, Gaussian 
elimination fails and the system has dependent rows. Continuing with our 
previous situation (the next pivot element is 2): 


—2 0 4 2 
Rez _ 2Ro => Rs gives 0 2 4 2 5 (5.18) 
0 0 -2 -4 


With this last matrix, we can again use back substitution and calculate the 
solutions for x,y,z. We mentioned that the solution set is not changed if we 
(i) multiply a row by a constant or (ii) add a multiple of one row to another. 
The solution set is also not changed if we (iii) interchange two rows. These 
three operations are called elementary row operations and are used to 
reduce the original system to one that is easier to solve. 

This process of zeroing out entries in our matrix, ultimately ending up with 
only zeros below the main diagonal of the matrix (i.e., an upper triangular 
matrix), is called Gaussian elimination. The element in the matrix that 
we use to “zero out” everything below it is called a pivot. It is sometimes 
convenient to make the pivots in (5.18) equal to one: 


{. G 8. 24 
Oo F djs (5.19) 
CC 1 32 


-1 1 
zhi Ri, 3Ro > Ro, 
=| R3 + R3_ gives 


Both (5.18) and (5.19) are upper triangular matrices, the only difference being 
that (5.19) has the number one as the first non-zero entry of each row. A 
matrix of this form is said to be in row-echelon form. In the event that 
some rows would end up with all zeros, row-echelon form requires that we move 
these rows to the end and keep the leading entry in this staircase layout. This 
should be believable because it is equivalent to switching the physical location 
of two equations and why should this change the solution? (It shouldn’t.) 

In Equation (5.18), we are able to see the pivots from this problem: —2, 2, —2. 
As it turns out, these give us a few additional facts: 
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1. det(A)=product of the pivots ( of A) 
2. A~+ exists only when all pivots are nonzero 


Thus, det(A)=8 and A is invertible. The latter of these can go into the 
equivalency statements of Theorem 5.2.1. 

In the case when a unique solution exists, it is also possible to obtain the 
final answer by continuing the process from (5.19) instead of doing back sub- 
stitution. In this situation, we reduce the row-echelon matrix to one that has 
only ones on the main diagonal, with zeros occurring in positions above and 
below the main diagonal in each column. The last row remains unchanged. 
The next step in this process, known as Gauss-Jordan elimination, is to 
work from left to right, eliminating all entries in each column that is not on 
the main diagonal. Normally, we would need to eliminate the entry in the 
first row and second column of the row-echelon matrix. But (5.19) already 
has this done and we thus proceed to the third column. We had 


10 -2 -1 
0 1 2 1 
00 1 2 
so that 
10 -2 -1 
Rz — 2R3 > Ro gives O 1 0 =o (5.20) 
00 1 2 
100 3 
R, —(—2R3) > Ri gives |0 1 0 —3]. (5.21) 
001 2 
Now the final answer, z = 2,y = —3,x2 = 3, can be immediately seen be- 


cause (5.21) is in reduced-row echelon form. 


This example was one in which we have a unique solution but we will not 
always have this situation. In performing Gaussian elimination, there may be 
times when we get “stuck” at a certain point in the problem. Sometimes the 
problem can be overcome by interchanging rows while other times it cannot. If 
we really are stuck at a certain point then we will either have infinite solutions 
or no solution. Consider the following system written as augmented matrices 
and observe the two elementary row operations needed for the first two steps: 


12 1 4 
00 -1 -6}]. (5.22) 
0 3 38 9 


Ro = 2R, —> Ro 


1 4 
: Rg = (—Hy) > Hy, 


1 2 
2 4 2 
-1 12°55 
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We cannot eliminate the “3” in the last row as our next step because the pivot 
above it is zero. However, we can simply swap the second and third rows: 


I 2 1 4 
0 0 -1 —-6 


This takes care of our problem and gives us an upper triangular matrix 
that can be solved by back substitution and gives x = 4,y = —3,z = 6, and 
our solution is unique. 

Let us instead consider the following system and first two elementary row 
operations needed: 


i 2a a 1 2 1 4 
[ee eee: R 

11 a F ve 219 3 3 9 |. (5.24) 

A o20 9-4 s e li we eG 


The next step is to eliminate the “—6” in the last row and we do so with 
1214 
Ha —\=2ha) > fy 10-3 2 9 (5.25) 
00 0 0 


The last row drops out of the system and we simply need to solve the first two 
equations. This yields an infinite number of solutions: « = —2+ z,y=3-z 
with z any real number. 

Finally, we consider the following system and first two elementary row op- 
erations needed: 


1 2 1 4 1 2 1 4 


hRoCA= Fk 
et +i ae 2 oe ie 710 3 3 9 |. (6.26) 
a en | ae : ee TG: ithe 2B -= 210 


The next step is to eliminate the “—6” in the last row and we do so with 
1214 
R3—(—2R2)> Rs |0 3 3 9]. (5.27) 
000 8 


The last row doesn’t make any sense and we thus say that the original system 
is not consistent and there is no solution. 


| Example 2: In Section B.1 of Appendix B, we consider the systems of equa- 


tions 


r+2y =4 3x — 3y = —6 —“u+ 
—“+y =2, —“+y =2, —x4 


(a) (b) (c) 


= 2. (5.28) 


338 Chapter 5. Fundamentals of Systems of Differential Eqns 


Write the reduced-row echelon forms of (5.28a)-(5.28c) and interpret the re- 
sult. 


Solution 
For Equation (5.28a), we have 


& ' 1 [o : 3} [0 ' At (5.29) 


This gives us the solution x = 0,y = 2. For Equation (5.28b), we have 
OF 8). 6 3 =3. =6 1 -1 -2 
Ee i: 2 ea 0 0 eae 0 0 |. oy) 
Our solution must satisfy «—y = —2. There are infinitely many solutions and 
we introduce a parameter ¢ as an independent variable that will give us our 


solution: 
f=—24+¢, y=, 


where t can be any real number. For Equation (5.28c), we have 
-1 1 -1 -1 1 -1 
fa pat yy. a 
For this situation, we see that there is no way to satisfy both equations and 


we call this an inconsistent set of equations (no solution). = 


| Example 3:| Consider 


a +2%2-—273+2%4=3 
22, + 4%. —4%34+ 344 = i. 


Performing elementary row operations on the augmented matrix gives 


id =i 3 
F 0 1 1 Ee ee) 


as the resulting echelon matrix. This system is consistent and with infinitely 
many solutions. We had previously defined the pivot elements as the first non- 
zero element in a given row for a matrix in echelon form. We further say that 
the columns with pivot elements are called the basic variables (or leading 
variables) while all the others are the free variables. In this example, 21 
and x3 are the basic variables whereas x2 and x4 are free variables. The free 
variables are set to different (arbitrary) parameters, say 2 = s and x4 = t. 
Our solution can then be written as 


t= —2-—2s—2t, t3=-5-t 


and any choice of s and ¢ will give a solution. 
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| Example 4: | +2) Consider Ax = b as 


13 by 

4 3 [=| = bo | . (5.33) 
v2 

3 1 bs 


For b = [0 —5 —5]’, find the reduced-row echelon of the system and 
the resulting solution, if one exists. Then find the solution for (5.33) for the 
general b as written. What conditions are necessary for a solution to exist? 


Solution 
Performing row reduction gives 


1 2 O 1 0 -2 
4 3 —-5}/—]0 1 1 |. (5.34) 
3 1 -5 00 0 

Thus, 7; = —2,x22 = 1 is a solution. The first two columns of the reduced 


echelon form show that the columns are linearly independent and because the 
last row contains all zeros, we conclude that the vector b can be written as a 
linear combination of the two column vectors of A. 

When we consider the general b, row reductions give 


12 bh 1 0 4(—3b1 + 2b2) 
4 3 bo} —+|0 1  4(4b:—b2) |. (5.35) 
3 1 bg 0 0 by — by +b3 


In order for a solution to exist, we thus need b; — b2 + b3 = 0. Thus any 
solution to (5.33) must lie in the plane a — y+ z = 0, that is, the plane with 


normal vector [-1 1 —1]?. - 


Problems 


In Problems 1-6, write the systems of equations as an augmented matrix. 


” { x1 +4a =3 . eae 
, 2241 — 52g = —1 , 249 = —5 
3 8x — 243 = -1 A oe 
: at, — 49+ $23 =0 , —%,+2723 =1 
v1 +209 — 743 +504 =1 —%, 4+ 2%0 +543 +244 = 3 
5. 2, —234+ 324 = —2 6. %—-@% =4 
2241 + 3%2 — 9434+ 3244 =8 2%, + 3x2 —4%3 +244 = —2 


In Problems 7-12, perform back substitution to solve the system. 
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2, +422 =3 @1— 34% =5 

2 6 =2) =1 1 0 —-2 -1 
9.;0 -3 1 0 10.;0 -—-2 1 0 

0 0 2 2 0 O 2 2 

1 3 —6 0 21-2 -3 
sae F —-2 1 1 a E 1 -2 1 


In Problems 13-20, (i) use Gaussian elimination to reduce the matrix to eche- 
lon form and then back substitution to solve the system; (ii) use Gauss-Jordan 
elimination to solve the system. 


oe 14 aren! 

541 + 7xo = 3 * ) 2a, +29 =8 
2%, +442 = 6 —2%7, +4272 =3 
321 + 6x49 = 9 4a, — 8% = 1 


"| a 
x1 — 343 = —2 %1+%2+2%3 =—-1 
321 fais LQ — 2x3 =) 18. @, — 2%. 4+ 73 =-9 


si 222 L3 =<4 321 +%2+%3 =3 

2% +323 =3 @ — 2%2 + 273 +244 = 2 
322 + 843 = 4 a, — 2%, +%73+2%4=4 
ca eed %+%2+%3+2%4=1 


5.3 Vector Spaces and Subspaces 


We call a set V a vector space if its elements satisfy the same properties 
of addition and multiplication by scalars that geometric vectors do. More 
precisely, we have the following definition. 


Definition 5.3.1 

Let V be a set of elements (called vectors); this set, together with vector 
addition + and scalar multiplication, is termed a vector space if for c1, c2 
scalars and u,v, w in V the following axioms hold: 


(ii 
(iii 
(iv) u oe (ut+v)+w 

(v) There is a zero vector, 0, such that O+u=u 

(vi) Every vector has an additive inverse —u such that u + (—u) = 0 
(vii) a(u+v)=cqu+cv 

(viii) (4 +c2)u=cju+ cu 

(ix) c1(cou) = (c1c2)u 

(@) imu 
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|Example 1:| Consider all the solutions of a given nth-order linear homoge- 


neous differential equation. Together they form a vector space, specifically 
called the solution space of the given differential equation. We can easily 
check this by letting a, b be any real numbers and yj, y2, y3 be solutions. Then 
Theorem 3.2.1, which says that linear combinations of solutions are still solu- 
tions for any scalars, shows that each of the above axioms is true. We leave 
it to the reader to show this. Thus the space of all solutions is a vector Zo 


For differential equations, we have seen that elements of the solution space 
(a vector space) of a given differential equation are solutions to this differential 
equation. The concept of vector space is one that is taken for granted in many 
courses that incorporate math and we’ll illustrate the importance of knowing 
the vector space to which you are referring. In physics and engineering, we 
often consider a “vector” to be something with magnitude and direction. An 
example is 

Vv, = 2i— 3j. 


If you are told to sketch this vector, where would you draw it? Many of you 
would probably answer “in the x-y plane” and would go 2 units to the right 
and 3 units down from the origin to draw it. Now sketch the vector 


vo = 21 — 37+ 0k. 


Is there any difference? Yes! The second vector, vo, really lives in the x-y-z 
space even though its z-component is 0. Mathematically, this is a significant 
distinction. In multivariable calculus, vectors are often written using the 
notation 1, j, k. We will instead write vectors in a different form: 


2 
vi=a-a=|?,| and v2 = 2i—3j+0k= | —3 
0 


Vector v, lives in R? and elements in this space must have exactly two com- 
ponents both of which are real numbers (as opposed to complex numbers). 
On the other hand, vector v2 lives in R? and elements in this space must have 
exactly three components, all of which are real numbers. In order to answer 
questions about these kinds of vectors, we need to specify the vector space to 
which we are referring. 


Example 2: Consider all vectors of the form . With the normal com- 


ponentwise addition and subtraction of vectors, we can easily check that all 
the axioms of a vector space are satisfied. The vector form represents the gen- 
eral form of a vector that lives in R?, which is simply the familiar z-y plane. 
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There are many examples of vector spaces but we will focus our efforts on 
understanding the specific example of a solution space for a given differential 
equation. We stated that all possible solutions of a linear homogeneous dif- 
ferential equation form the solution space for that differential equation. We 
have also described a fundamental set of solutions for a given nth-order linear 
homogeneous differential equation as being the elements (solutions) necessary 
to generate all possible solutions. This brings us to two more important top- 
ics, each of which is satisfied by this fundamental set of solutions. 


Definition 5.3.2 

A set of elements of a vector space is said to span the vector space if 
any vector in the space can be written as a linear combination of the 
elements in the spanning set. 


It should be believable that if we don’t have a set that spans the vector 
space, then we can possibly add more vectors so that it does span. In terms 
of differential equations, the following example illustrates this idea. 


| Example 3:| Consider the set of vectors 


‘7 fo) 2 
OG) hills 
o| fo] |o 


in R°. This set of vectors does not span R® because we can never obtain a 
non-zero entry in the 3rd component. Thus, the set does not span R*. If we 
include the vector [0 0 1)" in the set, then the resulting set would span R°. 


|Example 4:| Consider the differential equation y”(x) + y(#) = 0. We can 


easily check that 


{sin x, V3 sin 2} 


are solutions but that this set cannot generate all possible solutions. For 
example, we could never write 2cosz as a linear combination of these two 
elements (solutions). If we also include 2 cos, the resulting set 


{sin a, V3 sin x, 2.cos x} 


does span the space. That is, all solutions of y’’(a) + y(a#) = 0 can be found 
by taking linear combinations of the solutions in {sin x, /3sin x, 2 cos x}. 


At this point, we hope you are wondering why we don’t just take the fun- 
damental set of solutions as our spanning set in the case of a solution of a 
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differential equation. The short answer is we could and we will! Regardless 
of the vector space, our ultimate goal is to find a set of vectors that spans 
the given space and is also linearly independent. Having a set with these 
two characteristics gives us the smallest possible set that can generate every 
element in the space. 


Definition 5.3.3 
A basis of a vector space is any collection of elements that spans the 
vector space and is also linearly independent. 


Finding a spanning set sometimes requires adding more vectors to the given 
set, thus increasing the number of elements. Finding a linearly independent 
set sometimes requires discarding vectors that can be written as linear com- 
binations of vectors in the given set, thus decreasing the number of elements. 
Finding a basis for a vector space is finding the balance between a set that 
has enough elements to span but not so many that there is any overlap or 
redundancy. We can state a nice theorem that relates these two concepts. 


THEOREM 5.3.1 

Let V be a vector space with a basis consisting of n vectors. Any set that 
spans V is either a basis of V (and thus has n vectors) or can be reduced 
to a basis of V by removing vectors. Any set that is linearly independent 
in V is either a basis of V (and thus has n vectors) or can be extended 
to a basis of V by inserting vectors. 


We note that for this theorem, we do not say that we can add or remove any 
vectors we wish. In the case of a spanning set, it is necessary to only remove 
the ones that don’t contribute anything new, while in the case of the linearly 
independent set we can only add vectors that are not already included. 

The number of elements in the basis also tells us the size of the vector space. 
This may seem trivial in the case of a solution space—we know that for an 
nth-order linear homogeneous differential equation, any fundamental set of 
solutions, i.e., any basis, must have n elements. The size of a general vector 
space is often a very useful piece of information. 


Definition 5.3.4 

Let {ui, U2,--- , un} be a basis for a given vector space. The dimension 
of this vector space is equal to the number of elements in the basis, i.e., 
n in this case. 


| Example 5: | Consider the Cartesian plane, R?. The set 
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is a basis for the space. Why? If we consider any vector , we can write this 


a 
b 
as a linear combination of the two basis vectors, av; + bv2. Thus the set spans 
the space. It should also be clear that cv; + c2vg = 0 only when c; = cp = 0 
and thus the two vectors are linearly independent. This particular basis is 
known as the standard basis and its vectors are often denoted e1, e2. - 

We finish this section with one additional concept, that of a subspace. 
Removing elements from a basis yet still having a basis (but of a different 
space) gives rise to this notion of a subspace. 


Definition 5.3.5 

Let W be a subset of a vector space V. We call W a subspace if the 
following three properties hold: 

(i) W contains the zero vector. 

(ii) W is closed under addition; that is, if u,v are in W then so is u+v. 
(iii) W is closed under scalar multiplication; that is, if c is a scalar and 
ua vector W then so is cu. 


| Example 6: | Consider the two-dimensional Cartesian plane R? and its stan- 


dard basis. The y-axis is a subspace of R? because any linear combination of 
vectors on this axis necessarily remains on this axis. In fact, any line through 
the origin is a subspace of R?. 


| Example 7:| Consider the equation y/” — y+ y/ — y = 0. It is straightfor- 


ward to check that a fundamental set of solutions is given by {cos z, sin x, e*}. 
A subspace of this solution space can be created by taking {cos z,sinx} as 
the basis for it. We know this particular subspace is also the solution space 
for the equation y” + y = 0. Any solution in the subspace remains in the 
subspace. In order to leave the subspace, we must make a linear combination 
with an element not already in the subspace, in this case with e”. 


5.3.1 The Nullspace and Column Space 


We conclude with some ideas that tie together the discussion of this section.” 
We began our discussion by considering Ax=0. We thus want to know what 


1As mentioned earlier, a first step is to check that the vectors under consideration live in 
the proper space. Checking that you have a basis for a vector space is analogous to checking 
the conditions for a fundamental set of solutions. You need the following: (1) the same 
number of vectors as the size of the space, (2) the vectors need to be in the proper space, 
and (3) the vectors must be linearly independent. 

2See any of the numerous linear algebra books, for example, Strang [47], for a more in-depth 
discussion. 
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vectors, when left-multiplied by A, will give us the vector 0. While x = 0 
will always work, we are usually more interested in the non-zero vectors that 
will work. 

Consider the following matrix equations: 


>. i D7) fl 0 Oe DTH 0 
2 —2 2|]1|=|0|] and |2 -2 2/|0]=Jo]. (6.36) 
fod A 0 0 ft et al ea 0 


Thus, the matrix A takes both [1 1 0]? and [—1 0 1)” to the zero vector 
(0 0 O|*. Is this a property of the vectors or the matrix? Actually, it’s 
both. The structure of the given matrix is such that any vector that is a 
linear combination of the above two vectors is also sent to the zero vector. 
And it’s not hard to construct similar examples for an m x n matrix as well. 
For example, we can also see that 


2-2 27 /t/_fo) o, [2 -2 2715/_/9 
3 3 -3]];/~ lo} ™ 3 3 -3]|7|~ Lo} 


The following definition will clarify this situation: 


Definition 5.3.6 


The nullspace of an m x n matrix A is defined as 


null(A) = {x € R”|Ax = 0}. 


We note that null(A) is a subspace of R”. This is easily seen because it 
satisfies the three conditions of a subspace: 


(i) We know the zero vector is in null(A) because AO = 0. 

(ii) If x, y are two vectors in null(A), then A(x + y) = Ax + Ay and thus 
x+y is in null(A). 

(iii) For any scalar c and any vector x in null(A), we have A(cx) = cAx = 


cO = 0 and thus cx is in null(A). 


Because the three conditions are satisfied, we conclude that null(A) is indeed 
a subspace of R”. 


Sometimes the nullspace of A is referred to as the kernel of A. We also 
observe that not all vectors are taken to zero. In the examples immediately 
preceding Definition 5.3.6, we can see that matrix A takes [1 0 2]7 and 
[1 0 1]7 to [6 —9]7 and [4 —6]?, respectively. What about these vectors 
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that are not taken to zero upon left multiplication by a matrix? We have 
another definition. 


Definition 5.3.7 


The column space or range of an m x n matrix A is defined as 


R(A) = fy € R™|Ax = y}. 


We note that R(A) is a subspace of R™. It is also called the column space 
because it is the subspace of R™ that is spanned by the columns of A. We 
also show this: 

(i) We know the zero vector is in R(A) because AO = 0. 


(ii) If yi, y2 are two vectors in R(A), then we know Ax; = y; and Ax2 = yo 
for some vectors X1, X2 in R". We then have A(x;+xX2) = Ax;+Ax2 = yity2 
and thus y; + y2 is in R(A). 


(iii) For any scalar c and any vector y in R(A), we have A(x) = y for some 
x. Then A(cx) = cAx = cy and thus cy is in R(A). 


Because the three conditions are satisfied, we conclude that R(A) is indeed a 
subspace of R™. 


At this point, we pause to define another important concept of linear alge- 
bra. 


Definition 5.3.8 
The rank of a matrix A is the number of linearly independent columns 
of A. 


This definition gives us the following useful result, where rank(A) = r: 


dim(R(A)) =r. (5.38) 
Let’s consider the matrix 
2 -2 2 2 
A=/]2 -2 2 1]. (5.39) 
1 -1 1 0 


Bases from the nullspace and column space can be found easily using MAT- 
LAB, Maple, or Mathematica. We will proceed by hand. Since we want to 
find vectors in the nullspace, we don’t need to consider the augmented ma- 
trix explicitly since the additional column would be all zeros. Performing 
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elementary row operations on A gives 


2 oY 
¢ 0 6-21) (5.40) 
0 0 0 0 


If we think of each of our columns as corresponding to a variable x;, we 
observe that x2 and x3 are the free variables and our nullspace will thus have 
two vectors in its basis. Since any vector in the nullspace must right multiply 
this and give zero, we know that 24 must be zero (because it’s the lone entry 
in the 2nd row). The remaining equation that must be satisfied for vectors in 
the nullspace is thus 2x”, — 2%2 + 2%3 = 0. We set one of the free variables to 
one and the other to zero: 72 = 1, 73 = 0 and solve the first row for 7;. We 
then switch the values of our free variables: x2 = 0, 73 = 1 and solve again 
for x1: 


1 —1 
r=1 1 r2 =0 0 
ca 0 and ci ‘ee (5.41) 
0 0 
— 
basis vector another basis vector 


If more free variables had been present, each of them takes a turn being set 
to one while the others are zero. We thus obtain a basis for our nullspace as 


—1 


null(A) = (5.42) 


1 

1 0 
O;’>); 1 
0 0 
For the column space, the presence of two basic variables tells us that it will 
have two vectors in its basis. The pivot columns are the lst and 4th and so 


a basis for the column space will be the 1st and 4th columns of the original 
matrix: 


a7; [2 
R(A)=¢ {2},]1] $. (5.43) 
1} |0 


For our matrix A, we have m = 3, n = 4. We should observe that we 
do have null(A) c R*, R(A) C R®, as we showed earlier. There is another 
worthwhile observation for this example: 


dim(R(A)) + dim(null(A)) = 4. 


The following is true in general and is a very important result in linear 
algebra: 
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THEOREM 5.3.2 


For an m X n matrix A, we have 


dim(R(A)) + dim(null(A)) =n. (5.44) 


There is an interesting analogy between solving nonhomogeneous linear 
ODEs and solving the system Ax = b. Sections 1.3 and 5.1 describe how the 
linear ODE oy +P(x)y = Q(z) has the general solution of the form y = yn+yp 
(and similarly for the vector version). For a linear system Ax = b, we can 
also think of the solution as being x = x, + xX,. If this is the case, then we 
need 

A(x; + Xp) = (0+b). 
Thus, we see that to get x, we take the right-hand side equal to 0. In other 
words, it is the dependent columns of A that give rise to the homogeneous 
part or, equivalently, xp, is in the nullspace of A. 


MAME Write the solution to 


1 4 -—1 
3 «12 | as 
ee 2 
in the form x = Xp, + Xp. 
Solution 
We know that x; is obtained from the homogeneous equation 
1 4 0 
3 12 |x, = |0 
—2 -—8 0 


Since the second column is a multiple of the first, we obtain 


xX, =C- | 
for any constant C. A particular solution, by inspection (of, e.g., the first row 
in Ax = b), gives 
-1 
Xp =| 9 |- 


Thus, we can write the solution to the original system as 


pecgemal ota 


1 0 a 
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Problems 


In Problems 1-8, show that the given set of vectors forms a basis for the 
specified vector space. 


Sieh ey ces (OVC 
‘| a 


10] [3 2] [2 
= {P| lp ® “tte | [spe 
1 i 1 2 1 0 
5.</1],J/1},}/0] 5, R% 6 1],]-1},]/3] >, R° 
HBB RE AE) Bh 
1 0 a 1 
0 1 2 0 
i OT?) 0.) * )or 12 »RY 
2 -1 1 0 
-1 1 0 2 
1 —2 3 0 
2 A ea 1 |*}-1 -R 
1 0 -1 0 


In Problems 9-21, determine whether the given set of vectors forms a basis 
for the specified vector space. 


iA L)}® 10 {| alo a | 


ie oe 
Po 


R4 
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1 0 2] fl 
0 0 2) |o 

Bs) colli. 1 hg gi eee 
1 1 2) |o 


22. Show that R? is a vector space. 
23. Show that R® is a vector space. 
24. Show that the set of all 2 x 2 matrices with real entries, R?*?, is a vector 


space. 
25. Show that HE a . lo | ‘ hi | . k |} is a basis for R?*? (see previ- 


00 00 10 01 
ous question). 
26. Show that the plane z = 0 (i.e., the z-y plane) is a subspace of R°. 
27. Show that the plane x = 0 (ie., the y-z plane) is a subspace of R°. 
28. Show that any plane passing ehrouch the origin in R? is a subspace of R®. 
29. Show that the set of m x n matrices forms a vector space with the previ- 
ously defined rules for addition and scalar multiplication. 
30. Show that the dimension of the vector space of 2 x 3 matrices is six. 


Find bases for the column space and nullspace of the following matrices given 
in Problems 31-38. 


1 3 i 4 is 4 
31 E 7 32 E eal 33. E ; ; 
1-3 1 Si 1 4 2 1 -1 0 
a E 0 | = ki 3-1 ba ae E -1 -1 | 
-1 3 4 -6 
37.12 -6 38.| 8 —12 
-1 3 -2 3 


In Problems 39-43, construct examples of the following matrices. 

39. A 2 x 2 matrix that has a nullspace consisting only of the zero vector. 
40. A 2x2 matrix that has a nullspace with a basis consisting of one non-zero 
vector. 

41. A 3x 3 matrix that has a nullspace consisting only of the zero vector. 
42. A 3x3 matrix that has a nullspace with a basis consisting of one non-zero 
vector. 

43. A 3x3 matrix that has a nullspace with a basis consisting of two non-zero 
vectors. 


In Problems 44-46, find bases of the nullspace and column space. Then repeat 
this with MATLAB, Maple, or Mathematica and comment on any differences. 
2 -1 1 2 —2 2 2 -1 3 1 
44.;2 -2 4 45./2 —2 2 46./2 —~2 2 1 

6 —4 6 1 -1 1 0 1 1 0 
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Another subspace can be obtained by considering the rows of A, which are 
the same as the columns of A?. We thus define the row space of an m x n 
matrix A as 

R(A*) = {x € R”|A’y = x}. 


In a similar manner, we define the left nullspace of an m x n matrix A as 
null(A”) = {y € R™ly7 A = 0}. 


We note that the row space is a subspace of R” and the left nullspace is a 
subspace of R™. Two useful results that follow for an m x n matrix A are 


e dim(R(A‘)) + dim(null(A”)) = m. 
e dimension of row space = dimension of column space = rank. 


In Problems 47-50, find bases of the nullspace and column space. Then repeat 
this with MATLAB, Maple, or Mathematica and comment on any differences. 


2 -2 2 2 =] 1 2 —-2 2 2 
47.|;2 -—2 2 48.|;2 -—2 4 49, A=|]2 -—-2 2 2 
1 =i. 6 -—4 6 1 =f 1 0 
2 -1 3 1 
50.A=/2 -2 2 1 
0 1 1 0 


5.4 Eigenvalues and Eigenvectors 


We have seen that we can write the linear system of equations 


dx +b 
es A 

do | 
d 

a art dy 


in matrix-vector notation x’ = Ax. If x,A € R, then this equation is easily 
solved by separation of variables, with solution x = cje“!. When we consid- 
ered nth order linear homogeneous equations with constant coefficients, we 
similarly guessed a solution of the form y = e’”, substituted the result into 
the equation, and obtained the characteristic (or auxiliary) equation; solving 
for the roots gave r-values that made y = e’™ a solution. Thus even though 
x € R",A € R”*", we might still hope that we can find an exponential so- 
lution. Analogously to what we’ve done before, we assume a solution of the 
form 


x =ver, 
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where v is a vector (same size as x) and A is a scalar. (Either of these may 
be complex.) If ve* is a solution, it must satisfy the original differential 
equation x’ = Ax. Substitution gives 


re*ty = Ae**y. (5.45) 
Because e** 4 0, we can divide by it to obtain the equation 
Av = dv. (5.46) 
Thus, 
ve™ is a solution to x! = Ax if we can find v,X such that Av = dv. 
In this section, we will consider the consequence of a square matrix acting 
on a vector v and yielding a constant multiple of the same vector v. In 


symbols, we have 
Av = Dv, (5.47) 


where A is a constant, called a scale factor. The scale factor 4 modifies the 
length of the vector v. 


| Example 1:| Consider the matrix 


with 
2 1 
AV=—lvi= BF and A2 = 3, v2 = iE 


Verify that Av; = Av; for 2 = 1,2. 


Solution 
We multiply to obtain 


& 7 H 7 =| ==1}] (5.48) 


—~__—_—_—_"” Ay ~~” 
A Vi Vi 
and 
—5 8/1 3 1 
+ li) -[3)-2] (64 
— aye A2 ~~” 
A V2 v2 
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The previous example showed two situations where the same matrix multiplies 
two different vectors and only changes them by scaling or stretching them. 
Note that multiplication of any vector by this matrix does not necessarily 
simply stretch it. For example, 


ee alee 


which cannot be written as a product of a scalar and (1 — 2)?. 

A vector v that satisfies Av = Av for a given matrix A is called an eigen- 
vector of A and the factor by which it is multiplied, A, is called the eigen- 
value of the matrix corresponding to the particular eigenvector. The eigen- 
values and eigenvectors of a given matrix give us tremendous insight into the 
behavior of the matrix in situations as seemingly different as raising a matrix 
to a power to solving a system of differential equations! 

We will now consider how to find the eigenvalues and eigenvectors associated 
with a matrix A. Let us consider this same matrix 


—5 8 
te i ak 
We want to find \ and v so that 
Av =).v. 


Equivalently, 

(A — ADv =0. 
Non-trivial solutions occur only when the matrix (A — AI) is singular. From 
Theorem B.1.2, this happens when 


det(A — AI) = 0. 


This determinant gives us a polynomial in 4, called the characteristic poly- 
nomial for A, and when we set it equal to zero, we have the characteristic 
equation for A. In our specific example, calculating the characteristic equa- 
tion gives 

MW —2\-3=0. 


This characteristic equation is solved to obtain the characteristic roots, 
or eigenvalues, keeping in mind that we allow for complex roots as well as 
real roots. Because we allow for complex roots, the Fundamental Theorem 
of Algebra guarantees that there are exactly n roots when the characteristic 
polynomial is of degree n. As you may be aware, there is no general formula 
that exists for finding the roots of a polynomial that is degree 5 or higher. 
Having the help of MATLAB, Maple, or Mathematica to find the eigenvalues 
or the approximations of them will be very useful. Again referring to our 
specific example, the characteristic equation can be rewritten as 


(A—3)(A+1) =0, 
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which gives roots of 4; = —1, Az =3. 
Once we have the eigenvalues, we take each one in turn and plug it into the 
equation (A — AI)v = 0 and solve for v. For this example, 


Ah 0 ale te me mt] = [9] 


=> —4v11 + 8vq1 = 0. 


You might think of any number of possible combinations that will make 
this last equality true. In fact, any v1, voi that satisfy v11/v21 = 2 will work. 
Thus the eigenvectors are not unique in magnitude. Another way to think 
of this is that any non-zero multiple of an eigenvector is still an eigenvector. 
For example, if v is an eigenvector, so are —v and 2v. The simplest choice is 
perhaps vj; = 2, v2; = 1 which then gives 


“fl 


as the eigenvector corresponding to the eigenvalue A; = —1. We could do a 
similar calculation to obtain 
1 


as the eigenvector corresponding to the eigenvalue Az = 3. 


For those who have read Section 5.3, we define 
Ey = {v|(A — AT)v = 0} (5.50) 


and say that E) is the eigenspace of \ and is indeed a subspace. We also note 
that v is in the nullspace of (A — AT)v. 

We note that the above method worked in a straightforward fashion because 
our eigenvalues were real and distinct. If they were complex, we can still find 
eigenvectors but it is a bit more work as we will see later in this section. 
If we have eigenvalues that are repeated, we can try to plug them in as we 
did above, and this will give us at least one eigenvector but we may or may 
not be able to find more. Sometimes we will need to obtain a generalized 
eigenvector; this will be discussed in Section 5.6. 


| Example 2:| A matrix A is said to be symmetric if AT = A. Find the 


eigenvalues and eigenvectors of the symmetric matrix 


2: 3 
a E | , 
Solution 


Calculating the characteristic equation, we find that (2 — A)? — 9 = 0, so 
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that A = 5,—1. We take each eigenvalue in turn to find its corresponding 
eigenvector: 


At =5% (A = ar =0 (5.51) 


[iP 2dfel-B] oe 


=> —3011 + 3v21 = (5.53) 


Choosing v1; = v2, = 1 is a good choice. Repeating with the other eigenvalue: 


AQ =-1: (A = A2I)v2 =0 (5.54) 
2- (—1) 3 U12 _ 0 
= Pos" ata] [ad] =f] 59 
=> 3v12 + 3v22 = 0. (5.56) 
We can choose vj2 = 1,v22 = —1 as one possible pair. Thus we have 


Ll} ot 1 [2]. 


A special property of any symmetric matrix is that its eigenvalues and 
eigenvectors are always real-valued. 


We revisit the equivalence theorem of the last section and add one more 
result. We will conclude our brief introduction to eigenvectors and eigenvalues 
with two important theorems. We will have occasion in later sections to make 
use of both of these results. The first theorem is an important and useful 
characterization of an invertible n x n matrix A. 


THEOREM 5.4.1 

The following are equivalent characterizations of the n x n matrix A: 
(a) A is invertible. 

b) The system Ax = b has a unique solution x for each b in R”. 

) The system Ax = 0 has x = 0 as its unique solution. 

) det(A) # 0. 

) The n columns of A form a basis for R”. 

) 0 is not an eigenvalue of A. 


( 
(c 
(d 
(e 
(f 


Regarding (e) in this theorem, we note that because the columns of A form 
a basis of R”, they automatically span R” and are linearly independent. We 
also remind the reader that there is never a unique basis for a given vector 
space. In fact, it will often be useful to convert from one basis to another and 
we will do so when we analyze the stability of solutions in future sections. 
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We refer the reader to Appendix C for a discussion of change of bases and 
coordinates. 

The next theorem connects the trace and determinant of an n x n matrix 
A with the eigenvalues of A. This theorem will be used in Chapter 6 when 
we wish to analyze the qualitative behavior of a linear system. 


THEOREM 5.4.2 


Let ; denote the eigenvalues of an n x n matrix A. Then 


Tr(A)=S >A, det(A) =] | X. 


We note that Theorem 5.4.2 does not say that the eigenvalues lie on the diago- 
nal. Sometimes this will be the case (for example, with triangular or diagonal 
matrices) but usually the eigenvalues do not appear in the matrix. Neverthe- 
less, we now have a way to calculate the trace and determinant in terms of 
eigenvalues. 


Eigencoordinates 


Although we were able to obtain the solution to the system in terms of the 
variables x and y, it is sometimes easier to solve the system in the coordi- 
nate system of the eigenvectors (called the eigencoordinates). We refer 
the reader to Section B.4.1 in Appendix B for a more general discussion of 
coordinate transformation. We again consider the system of Example 1: 


—=-5 8 

ai r+ 8y 

dy 

Oe gs dl 5 ; 

en a+ Ty (5.57) 


Rather than convert the system to a second-order equation or examine it 
in the phase plane, we choose to find a linear change of coordinates that 
will make the system uncoupled, i.e., where each equation will only have 
functions and derivatives of one variable. If we create a matrix V with the 
columns being the eigenvectors v, = [2 1]7, v2 =[1 1)”, then we can write 
our original variables x,y in terms of the eigencoordinates wy, ug: 


H 7 F i ak ie. x= Vu. (5.58) 


However, it is the opposite relation that will allow us to write our equation in 
eigencoordinates. The matrix V is invertible since it has eigenvectors as its 
columns. In order to solve for the eigencoordinates, we will need the inverse 
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of a 2 x 2 matrix, given in Appendix B as (B.27) and here as (5.59): 


Si) -wel’ 7’) = 


We then left-multiply by V~! to obtain 


By 7 E =) FI: (5.60) 


We can also write the eigenvalue-eigenvector equations, Av; = A;v; for i = 
1,2, as a matrix-vector system: 


AV=VA (5.61) 


where we note that the order on the right is indeed VA for the matrix A 
that has the eigenvalues 41, Az on the diagonal. Just as we did above we can 
left-multiply by V~!, this time to obtain 


V'AV=A. (5.62) 


Combining the above discussion together: we had our original system as x’ = 
Ax which in eigencoordinates is Vu' = AVu, which we left-multiply by V~+ 
to obtain 

V-'Vul = V7! AVu. (5.63) 


We then substitute V~-!AV = A to obtain 
a = A (5.64) 


Thus, we have written our system of differential equations x’ = Ax as an 
equivalent system in its eigencoordinates: u’ = Au. We then have 


w =V'AVu= Au (5.65) 
(2 ste ef 71. Wf: Bia 

=[ aL allt aje= [o's] ee 
aw as 
v-! A V A ou 


Although this change of variables was a lot of work, (5.66) can be easily solved 
since each is a very simple separable equation. The solution is 


[ml- [eer|- 660 


If our initial condition in the original system is 7(0) = ao, y(0) = yo, then 
(5.60) together with (5.67) gives 


le] = pee (5.68) 
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Thus 
| _ | (zo — yo) e* | (5.69) 


uz (—29 + 2yo) e?! 


In terms of our original variables, recalling that (5.58) states x = Vu, we have 


Peace Fae een) 
= i (x0 — yo) €~* + (—20 + 2yo) | 


(xo — yo) e~* + (—ao + 2yo) e* (5.70) 


In studying differential equations from this approach, we observe that a proper 
choice of coordinates will often greatly simplify the system. 

In Example 2, we considered a symmetric matrix. Another useful property 
of a symmetric matrix can be seen when we try to diagonalize it via eigenco- 
ordinates. 


| Example 3:| Consider the matrix of the previous example: A = 2 | 


Her 
Normalize each eigenvector so that it has length one. Then find matrices V 
and A such that V-'AV = A. Can you see another way to calculate V~‘? 


Solution 
To normalize each eigenvector, we divide by its length and we put a ~ above 
the vector: 


a V1 _ [1 i)? 
“Ill v2 ear 
Aas om, v2 = [—1 | 
v2= Ivo] => V2 (5.72) 


The matrix V we seek is the matrix with these normalized eigenvectors as 


columns: 
V= [s: - et Ei Ful 
“aiovel v2lt } 
where we factored out the wi that was common in each term. The inverse is 
given by (5.59): 


1 1 
yas. v3 #| = J5[. il 
atal-ve va] vail} 
; 5 0 = a 
with A= | . We see that V~* = V* for our example. 
|_| 
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For a general n x n matrix Q in which Q-! = Q’, we call this matrix 
orthogonal. The columns of an orthogonal matrix satisfy two key properties: 
(1) q; L q; for 7 4 7, (2) ||q;|| = 1. The first step in our previous example was 
to normalize the eigenvectors so that (2) would be satisfied. Regarding (1), 
it turns out that the eigenvectors of every symmetric matrix are orthogonal 
(i.e., perpendicular) to each other. Thus for symmetric matrices, we can 
always diagonalize with an orthogonal matrix 


A = QAQ’. 


Because symmetric matrices arise in many real-world examples, these are use- 
ful facts to remember. 


Complex Eigenvalues 


Our approach when we have complex eigenvalues is no different—except that 
our algebra now requires the use of complex numbers. See Section 3.5 for a 
brief review of complex numbers, if necessary. 


peso 'S “= Consider the matrix 
2 -3 
3. 2 4° 


From our above discussion, we know that the eigenvalues are 2+ 32. But if 
we didn’t know/see this, we would proceed just as before. That is, we would 
calculate 


det(A — AI) = 0 => (2—A)?+9=0=> 7-4\4+13=0. 


This equation is quadratic and so we obtain 


4+ \/4? — 4(1)(13) _42tf7- GEO) _ wigs 
2(1) = ee Gy ee 


A= 


To calculate the eigenvectors, we again use the equation (A — AT)v = 0 to 
find the eigenvector by solving for v. Unlike the real case, however, we only 
need to find one of the eigenvectors—it turns out that the second eigenvector 
is the complex conjugate of the first! For this example, let’s use A; = 2 + 32 
to find vj: 


(A—AIvi =0 = eg ee Fa 7 [0 


—31 —3 Vil} 0 
PY JGI-0 
As before, the two rows of (A —jI) are constant multiples of each other—the 
second row is just the first row multiplied by 7. Thus we have 


—31011 — 3vq1 = 0 => —-i011 = V1. 
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We are free to choose any values for v1, v21 that will make this equation true 
as long as both are not zero. It is probably easiest to choose v1, = 1, which 
immediately gives vo; = —7. Thus 


A, = 2+ 37 has eigenvector v, = | : 


The second eigenvalue-eigenvector pair is just the complex conjugate of the 
first: 
Ag = 2 — 37 has eigenvector v2 = H . 
sl |_| 
As you might hope/expect, it is not a coincidence that the eigenvectors are 
complex conjugates of each other. That is, for complex eigenvalues, we will 
always have 


V2 =Vj. 


| Example 5:, Consider 
-1 -2 
Aye | 2 a | 
Find the eigenvalues and eigenvectors of A. 
Solution 


We can easily calculate the eigenvalues as A; = —1+ 22,A2 = —1— 27. The 
first eigenvalue thus gives 


0= (A = Ail)vi 


_ -1- (—1 + 2%) —2 V11 

i 2 -—1- (—1 + 2%) V21 

_ —21 —2 V11 

_ 2 — 21 V21 : 
At this point, in the case of real distinct eigenvalues, we always had the 
situation where both rows gave us the same information. That is also the case 


now and we can see this by multiplying the second row by —i, for example. 
Thus it doesn’t matter which row we choose, so let’s consider the first row: 


—21041 — 2v21 ='0); 


Our only restriction is that we can’t have vj; = v2, = 0. One possibility is 
thus v11 = 1, v2 = —i and this gives us the eigenvector (v1) corresponding to 
A, = —1+ 21. If we repeat the above steps for Ag = —1 — 27, we could obtain 
Vij = 1,v29 =1. Thus we have 
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We close by pointing out that for triangular and diagonal matrices, the 
eigenvalues were exactly the diagonal entries. For a real-valued matrix of the 


form, 
a —b 
| | 2 a,b € R, 
boa 
the eigenvalues are a+ib. We will revisit matrices of this form in Section B.3. 
e e e e e e e e e e e e 
Problems 


In Problems 1-18, calculate the characteristic equation of the given matrix 
by hand. Then find the eigenvalues and corresponding eigenvectors. The 
eigenvalues are real. 


oer a ee 
fo i] ets ca] tfraf & le a] 
9 E | 10 : a ne _ ; 12 E El 
5], Mileol Meo], tes o| 


In Problems 19-28, calculate the characteristic equation of the given matrix 
by hand. Then find the eigenvalues and corresponding eigenvectors. The 
eigenvalues are complex (nonreal). 


0 -1 —2 -3 3-2 1 —-2 
wf? 5!) a0.[2 3] an [2 22) a [tn 3 
5 
1 —-2 1 -8 
af) =2] as. 8] 


In Problems 29-34, use MATLAB, Maple, or Mathematica to find the eigen- 
values and eigenvectors of the given matrix. 


—2 2 0 3 1 0 1 -5 -1 
29.) 4 0 O; 30.; 2 4 0 53 a a 
—10/3 5/3 1 2/3 4/3 1 0 0 1 
af Sk 4 +~ + 0 10 O 
32.} 1 -1 0 33.|=* = 0 34.}1 0 -1 
0 oO 1 2 st -1 02 0 


In Problems 35-39, use the given substitutions to rewrite the equations as 
an uncoupled system. Then write the solution in terms of u,, u2 and use this 
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to find the solution in terms of x, y. 


35. u =o ~ yyy =~ 0 +2y for 

36. u = Be yin = me ty for fe 
37.u = fou = he ty for {Og 

38. u =-}r+ $uua= fe hy for {7 
39. u = $0 duu = ot by for {Fete 


In Problems 40-42, use A = VAV~! to efficiently calculate powers of a ma- 
trix: A? = VA"V—!. 


19} > 17% a. o Oey 
40. e 1 Al. ki | 42. | 0 3 0 
8 -4 -1 
A skew-symmetric matrix A is defined as one that satisfies AT = —A. 


For a matrix with real-valued entries, a skew-symmetric matrix always has 
complex eigenvalues. In Problems 43-45, find the eigenvalues of the given 
skew-symmetric matrices. 


0 1-1 
k= | °. dja 4 15 he | th 
1 0 3 0 ras 


5.5 A General Method, Part I: Solving Systems with 
Real and Distinct or Complex Eigenvalues 


In this section, we look at a general method for solving systems of first- 
order homogeneous linear differential equations with constant coefficients. It 
also provides a theoretical framework and makes one aware of what types 
of solutions are expected from such a linear system. Practically speaking, 
however, solving systems of three or more equations involves finding roots 
of polynomial equations of degree 3 or higher. Except in special cases, we 
need to use some technological tool to find these solutions. If we are using a 
computer algebra system, then we might as well just use it to solve the system 
and skip the method of this section. This is especially true if the graph of the 
solution is the only item of interest. On the other hand, if one is interested in 
the functional form of the solution, frequently the form of the solution given 
by a computer algebra system is large, cumbersome, and hard to study. Even 
simplification routines may not help much. In this case, the method of this 
section is valuable, even if we are using a machine to perform the individual 
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steps. From a philosophical point of view, it is important that we know how 
to solve a problem, even though we may let a machine do the work. 

Our discussion of eigenvalues and eigenvectors was motivated as a way to 
solve the constant coefficient, homogeneous version of our general system of 
linear equations (5.1), written in matrix vector form as: x’ = Ax. As a brief 
recap, we guessed solutions of the form x = cve*’ for some constant c # 0. 
Then the solution must satisfy the differential equation so that 


cA\ve™ = cAve™. 


We can divide by ce* ( 


as 


because it is never zero) and then rewrite the equation 


Av =v. (5.74) 


Now we are in the realm of an eigenvalue problem. In particular, the only way 
to have solutions other than v = 0 is to have the matrix A — XI be singular, 
which means that det(A— AJ) = 0. Evaluating this determinant yields an nth 
degree polynomial in \ which has n, possibly repeating and possibly complex 
(non-real) eigenvalues \1,...,An- Each of these eigenvalues is substituted for 
X in Equation (5.74), which in turn is solved for its corresponding eigenvector 
v;. Based on our discussion in Section 5.4, we know that this last equation 
says that ve* will be a solution of x’ = Ax when ) is an eigenvalue of A and 
v is the corresponding eigenvector. Thus one solution is 


where c; is an arbitrary constant. In the case when all the eigenvalues are 
real and distinct, we can state a general theorem. 


THEOREM 5.5.1 


Consider the system x’ = Ax, where the coefficient matrix A has n 


distinct real eigenvalues. Let A;,A2,:-: ,An be these eigenvalues with 
V1,V2,°"* , Vp as the corresponding eigenvectors. Then the c;v,;e**", i= 
1,2,---,n are linearly independent and the general solution is given by 


MS civie evse 2 beve 


and is defined for t € (—00, 0). 


| Example 1:| Consider the system 


xv =5a-y 


y = 3y: 


Find the general solution. 
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Solution 
In matrix form this equation is 


so that the eigenvalues of 


are found from 


5-A -1 


det(A— M1) =| 0 3dr 


|= 6-aB-a)=0. 


The eigenvalues are 
Ay = 3 and Az = 5. 


Now an eigenvector v, corresponding to 1 = 3 is found from 


oo [nl =[o] 


which gives 2111 = v21. Letting v1; = 1, we obtain the eigenvector 


eat, 


Similarly, an eigenvector v2 corresponding to \ = 5 satisfies (A —A2T)v2 = 0: 
0 —1 U12 4 0 
0 —2 U22 a 0 
so that vag = 0. We are free to choose vj2 to be anything except 0. So that if 
we let vjg = 1, then 
1 
v2= | 7 


So the general solution is 


|Example 2:1 Consider the following system: 


d. 

ety 
d 

7 = —4r — 5y + 2z 
d 

a re 


dt 
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Calculate the eigenvalues and eigenvectors. Then use Theorem 5.5.1 to write 
the general solution. 


Solution 
We can calculate the eigenvalues either by hand or with the computer. Doing 
so gives 

Ay = 3, Ag = —6, Az = —3. 


We can similarly find the eigenvectors either by hand or with the computer 
and we obtain 


as the respective eigenvectors. We can then write the general solution as 


—1 1 1 
x=ce |} 1 | +e.e7% | 2) +e3e7** | —1 
2 1 1 


or, alternatively, we could write the general solution as 


a(t) = —c,e** + cpe™* + cze7** 


y(t) = ce! + 2cpe% — cze7** 


z(t) = 2c,e** + cpe™ + cge**. 


Complex Eigenvalues 


In continuing our discussion of the solution of x’ = Ax, we now look at the 
case when the eigenvalues of A are complex. In Section 5.4, we learned that 
complex eigenvectors always result when eigenvalues are complex. Recall 
that we obtained the eigenvalue-eigenvector equation because we assumed 
solutions of the form ve**. Thus, if we started with x’ = Ax and found 
complex eigenvalues Ay = a +76, A2 = a—i (where a, 3 are both real) with 
corresponding (complex) eigenvectors v1, V2, then e*v, and e*2*v2 are both 
solutions to x’ = Ax. 

Although this is true, the non-appealing aspect is that both eigenvectors 
are complex-valued even though our original system had only real entries. We 
had a similar situation occurring in Section 3.6 when we obtained complex- 
valued solutions to a second-order equation. In that section, we used Euler’s 
formula to write a real-valued solution in terms of sines and cosines and that 
is exactly what we will do now: 


erty, = elotity, = e*'(cos Bt + isin Bt)v; 


erty, = elo-ity, — e (cos Bt — isin Bt)vo. 
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Theorem 5.1.2 tells us that any linear combination of solutions to x’ = A(t)x 
is still a solution. We also introduce real-valued vectors a,b that represent 
the real and complex parts of the eigenvectors, i.e., vi = a+ ib (and thus 
V2 =a-— ib). Using these facts we can rewrite a complex-valued solution: 
ket ty, + kyle tty, 

= ke“ (cos Bt + isin Bt)vi + kye**(cos Bt — isin Bt)v2 

= k,e™ (cos Bt + isin Bt)(a + ib) + kge™ (cos Bt — isin Bt)(a — ib) 

= kye*' [a(cos Bt) + ia(sin Bt) + tb(cos Bt) — b(sin Gt)] 

+ kye*' [a(cos Bt) — ia(sin Bt) — ib(cos Bt) — b(sin Bt)] 

= e™ {[k,a(cos Bt) — ky b(sin Bt) + kga(cos Bt) — kyb(sin Gt)] 
+ i[kya(sin Bt) + k, b(cos Bt) — kya(sin bt) — kgb(cos Bt)]} 
= e™ {[(k, + kg)a(cos Bt) + (—k2 — k1)b(sin Bt)| 
(i+) — kp)a(sin Bt) + (1 — k2)b(cos 8t)]} 
= e™ {[e,a(cos Bt) — ec, b(sin Bt)] + [c2a(sin Bt) + cob(cos Bt)]}, 


2. 


where the constants c, c2 are related to the k; by c, = ki +ke, cg = i(ki —ke). 
The constants are arbitrary and we thus have a real-valued formulation of the 
original solution. 

We state a theorem for the 2 x 2 case summarizing these results. 


THEOREM 5.5.2 

Consider the 2x2 system x’ = Ax whose coefficient matrix has eigenvalues 
Ay = a+if,A2 = a—i8, with a,@ real numbers. Choose one of the 
eigenvectors and write it as v; = a+ ib, where a,b are real-valued 
vectors. Then 


x1 = e™ [a(cos Bt) — b(sin Gt)] 
X2 = e™ [a(sin Bt) + b(cos t)] (5:75) 


are two linearly independent solutions, defined for —co < t < oo. The 
general solution is a linear combination of these two: 


x = e* {c, [a(cos Bt) — b(sin Bt)] + ce [a(sin Bt) + b(cos Bt)]} (5.76) 


|Example 3:| Write the real-valued general solution to 


x = > “2 x 
~ | 2 —1 : 
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Solution 
This example was considered at the end of Section 5.4. We found that A, = 
—14 27, A2 = —1 — 27, with corresponding eigenvectors 


[3 =O 


We rewrite one of the eigenvectors in terms of the real vectors a, b: 
1 
v, =a+ib=a= ‘ale b= ar 


With a = —1,8 = 2, Theorem 5.5.2 states that the general solution is 


x =e * {c; [a(cos 2t) — b(sin 2t)] + cg [a(sin 2t) + b(cos 2t)]} 


sige {a lh (cos 2t) — | (in2) 
rer lh (sin 2t) + "| (cos20)| \. 


We finish this section by tying together the techniques we have employed. 


THEOREM 5.5.3 

Suppose that x;,X2,--: ,X, form a fundamental set of solutions for the 
linear homogeneous system x’ = Ax. The general solution to this system 
is a linear combination of n linearly independent solutions 


6 = G14] ar Ca FP 98? a Cpe 


We saw an analogous statement in Theorem 5.1.3 but at that time we did 
not know how to compute any solutions. The previous theorems show us how 
to obtain a fundamental set of solutions and then we apply Theorem 5.5.3. 
As we have seen, obtaining a fundamental set of solutions may be very easy 
or quite complicated. 

e e e e e e e e e e e e 


Problems 


In Problems 1-17, find the eigenvalues and eigenvectors (they are all real) of 
the coefficient matrix and write the general solution. 


fa Agen, —_ or = 
i x — 2y 2. {9 w+ 2y 3.1% 4x —y 
y= -o Y = —2y y =6x+y 
A wv =3r+y 5 wv =5xr—y 6 wv’ =3r+9y 
“) ay =a24 3y ‘ly =3rt+y “\y =x24+3y 
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ee ee ea 

y' = —10r + 8y yi =a+2y y’ = 3a + 2y 

10. e _ a 11. ’ 7 aes 12. {y Se 
yee, ye, 
Cae Mi 


For Problems 18-26, find the eigenvalues and eigenvectors of the coefficient 
matrix. Then find the general solution (the eigenvalues are all complex [non- 


real]). 
uv! = —3y gv’ = —2y vw! = 3a + 4y 
18. e zm 19. i ge 20.4 oy an 4 By 
xv’ =—4r+2y x! = 3x —5y xv! = —Tx — Ay 
Fos i Sm eA : eee po y’ = 10a + 5y 
wv =x-y x! = —3x — Ay wv =x—5y 
iy ee, a6. {roe 


In Problems 27-32, use MATLAB, Maple, or Mathematica to find the eigen- 
values and eigenvectors of the coefficient matrix. If the eigenvalues are real, 
write the general solution; if they are complex, use the computer to find the 
general solution. 


vw =3xa+y vw! = —2a4 + 2y wv =-a%-2y+z 
27. ¢ y! = 2a + 4y 28. ¢ y! = 4x 29. ¢ y! = 2a —y+z 

zg =30-ytz2 2 =3yt+z 2 2 

vw =-a+y-2 vu! = 2a — 2y vw =-a+y-2 
30. 4 y’ =—-y 31. ¢ y! =3a-y 32.¢ y! =-y 

zg =“u-2 g=z zg =u—2z 


In Problems 33-34, consider the equation azx(t) + a,2’(t) + aox(t) = 0. 
Solve it using the methods of Section 3.6. Then use the methods of Section 
3.4 to convert it to a system of two first-order equations in the variables x(t) 
and y(t) = a(t). Solve the resulting system using the methods of this current 
section. Compare your two answers. 

33. a2 = 1,4, = 4,a9 = 3 34. a2 = 1,4, = 2,a9 = —8 


35. Social Mobility [37] Consider a town of 30,000 families (economic units) 
who have been grouped into three economic brackets: lower, middle, and 
upper. Each year 9% of the lower move into the middle, and 12% of the 
middle move back to the lower; 8% of the middle move to the upper, 
and 10% of the upper move down to the middle; finally 3% of the lower 
move directly to the upper, and 4% of the upper move down to the lower. 
These transitions occur continuously throughout the year as people are 
hired, laid off, fired, promoted, retire, and change careers. 
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We assume that initially there are 10,000 lower, 12,000 middle, and 8,000 
upper income families and consider the compartmental diagram for this 
situation is shown in Figure 5.1. 


FIGURE 5.1: Compartmental diagram for income class model. 
The system of equations is 


d 

=; = —0.12¢ + 0.12y + 0.042 
d 

+ = 0.092 — 0.2y + 0.12 

d 

— = 0.032 + 0.08y — 0.142. 


Find the general solution for this system and graph the solution. 


36. Consider the previous application but with the coefficients changed slightly 
so the system is now governed by the equations 


d 

7 = —0.14x + 0.01y + 0.04z 
d 

+ = 0.1lax — 0.09y + 0.1z 

d 

— = 0.032 + 0.08y — 0.142. 


Interpret the changes in the system compared to the previous one. Then 
use MATLAB, Maple, or Mathematica to find the general solution for 
this system and graph the solution. 


5.6 A General Method, Part II: Solving Systems with 
Repeated Real Eigenvalues 


We now continue our discussion of x’ = Ax, begun in Section 5.5. We had 
assumed a solution of the form cve™ and had concluded that A, v must satisfy 
the eigenvalue equation 

Av = Dv. 
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We discussed the situation where we have distinct real eigenvalues. What if 
the eigenvalues were instead real and repeated? As we will see, sometimes we 
will be able to use the methods of the previous section while other times we 
will not. To address the latter case, we begin to develop the theory of the 
Jordan Form as it applies to our discussion of solving systems of differential 
equations and refer the reader to other texts, such as [52] and [23], for a more 
thorough treatment of the topic. Although not required, it is best if the reader 
is familiar with some of the terminology in Section 5.3. 

We first consider the case of repeated real eigenvalues and use two specific 
matrices to show different scenarios. 


| Example 1: Find the eigenvalues and eigenvectors of 


n=) 28 J 


Solution 
For the matrix A, we can easily calculate the eigenvalues as A;,2 = 3,3. 
Substituting into (A — AI)v = 0 gives 


Ce le lea Pal | se 


Because this is true for any choice of v11,v21, we can choose, for example, 
U1, = 1,v21 = 0 to give one eigenvector and then vj2 = 0,v22 = 1 to give the 


other. Thus 
1 0 3 0 
v=]. v= |9| for a=|i Ap 


For our matrix B, we again have \;,2 = 3,3 and substitution into (B—AI)v = 


0 gives 
3-3 2 Vil} 0 2 VIL} 
0 38-3] }va}| [0 OF | ver} 
The second row of the system gives an equation that is always true, whereas 
the first row gives us 0- v4, +2+v9; = 0. This can only happen when v2; = 0. 


We are free to choose v1; to be anything (non-zero) and so we let v4, = 1. 
Thus we have one eigenvector 


1 Be 
vu=|o| for B=|j af 


Can we find another eigenvector? The short answer is “no.” The remainder 
of this section will be dedicated to finding another vector that will help us. 
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In this situation, we see that A had two eigenvectors even though the eigen- 
value was repeated. In general, if we can find n eigenvectors corresponding 
to n real eigenvalues (either distinct or repeated) for the coefficient matrix 
of a system of differential equations, we get lucky because we can write the 
general solution to x’ = Ax with the help of the following theorem. 


THEOREM 5.6.1 

Consider the system x’ = Ax, where the coefficient matrix A has 
real eigenvalue \ repeated n times. Suppose we can find n eigenvectors 
V1,V2,°"* ,Vm corresponding to this eigenvalue. Then the ¢;v,;e*", i = 
1,2,--- ,n are linearly independent and the general solution is given by 


At Mt Mt 
x= Ciwie ~ a7 Gavae 42589 se Gaia 


and is defined for t € (—00, 00). 


Combined with Theorem 5.5.1, we see that as long as we can find n eigen- 
vectors for a set of n real eigenvalues (regardless of whether they are distinct 
or repeated), we can obtain n linearly independent solutions with c;vje™’, i = 
1,2,---,n. If we cannot find the same number of eigenvectors as the multi- 
plicity of a repeated eigenvalue, such as the case with B, we will need another 
tool. 

If we put the above two matrices in the context of differential equations, 
Theorem 5.6.1 allows us to write the general solution of x’ = Ax as x = 
ce*'v1 +c2€%' v2 because we have two linearly independent eigenvectors v1, v2 
but we cannot do the same for B. The reader should recall that when we had 
a repeated root of the characteristic equation in solving an nth-order linear 
homogeneous constant-coefficient equation, we found a second solution by 
multiplying by t. Thus we had e", te”’ as linearly independent solutions. Is 
it still the analogous situation here? To see if this is the case, let’s assume 
that x = cgte*’v is a solution to x’ = Bx, then substitution gives 


co(e*! + 3te*)v = B(cote**v) 


1 1 
=> —_(e* + 3te**)v = Bv = Bv = |— +3] v. 
te t 


We know that v is an eigenvector of B and this last equation is not true 
because the corresponding eigenvalue is 3. Thus cate®’v is not a solution to 
x’ = Bx. It turns out, however, that te®’v is part of an additional solution 
but it is only a part of it. 

If we consider the general situation where A is a repeated eigenvalue of 
x’ = Bx and assume a solution of the form x = te*!v + g(t)u, where g(t), u 
are to be determined, we would need it to satisfy the differential equation. 
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Substitution gives 

(e* + dte*)v + g/(t)u = B(te*v + g(t)u). 
Rearranging this gives 


(e**)v + g/(t)u + Ate**v = B(te*'v) + B(g(t)u) 
= (e*)v + g/(t)u — B(g(t)u) = B(te*v) — Ate*'v 
= (e)v — (Bg(t) — g'(t)I)u = te (B— AT)v 

a eee 


= 
— (Bat) — g/()Du = (ev. 
If we set g(t) = e* then this equation becomes 
(B-— AI)hu=v, (5.77) 


and finding a vector u that satisfies this last equation would then give us an 
additional solution, which we could verify is linearly independent. 


Definition 5.6.1 
We say that u # 0 is a generalized eigenvector of A associated to the 
eigenvalue \ if 

(A —Al)*'u=0 (5.78) 


for some integer k > 0. The index of the generalized eigenvector is the 
smallest k satisfying (5.78). 


Our previous use of the word eigenvector, which we have always denoted v, 
corresponds to the case k = 1 in (5.78): 


(A —AD!v =0. 


The case of the matrix B from Example 1 corresponds to k = 2 in (5.78), 
which can be seen by expanding (5.77): 


(B — \I)?u = (B — AL(B— Au =(B-ADv=0. 
———s--—_——’ 


If we have more than one eigenvalue that repeats each with only one eigenvec- 
tor (e.g., Ay = 3 occurs twice with eigenvector v; and Az = —1 occurs three 
times with eigenvector v2), we write a subscript on the u and use the same 
superscript as the eigenvalue in order to ensure that we associate the original 
eigenvector with its corresponding generalized eigenvector: 


{vi, ul), us, a ut), . 
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If there is no confusion, we will drop the superscript on the u and the subscript 
on the v for convenience. For k > 1, we see that the original eigenvector gives 
rise to a set of generalized eigenvectors: 


(A — ADjug_-1 = ug_2, (A—AT)ug_2 = ug_3, -:-, 
(A — AT)ug = up, (A — ATug = uy, (A — ATU = v. (5.79) 
The set {v, Uj, Ug,-+- , Ug—1} satisfying (5.79) is called a chain of general- 
ized eigenvectors. The chain is determined entirely by the choice of v, which 
is referred to as the bottom of the chain. For those that have read Section 


5.3, we define 7 
Ey = {v|(A — A1)¥v = 0 for some k} (5.80) 


as the generalized eigenspace of . From (5.50), we note that Ly C Ey. If Vis 
an eigenvalue of A of multiplicity m, then EF) is a subspace of dimension m. 


| Example 2: Consider the matrix 


% 3-0 
A=|0 2 -1], 
00 2 


which has \ = 2 as an eigenvalue of multiplicity 3. Find the one eigenvector 
and the two generalized eigenvectors from (5.79). 


Solution 

To find the eigenvector, we solve (A — 2I)v = 0: 
0 3 0 VU11 0 
0 0 -1 vai | = i V21,U31 = 0, V11 # 0, 
0 O 0 U31 0 


and we can arbitrarily choose v;, = 1. There is no other linearly independent 
eigenvector—any other must be a multiple of v. To find the two generalized 
eigenvectors that result from this we solve (5.79): 


ak 
(A — 2Iu; =v = uw2= 3° 
and we choose u;,; = 0 because this is simplest and will still satisfy u, 4 0. 
Similarly, 


u13 = 0, ui,1 arbitrary, 


-1 
(A — 2T) uz =u, >> U2,2 = 0, U2,.3 = 3° U2,1 arbitrary, 


and we choose u2z,; = 0 because this is simplest and will still satisfy ug 4 0. 
Thus the chain of generalized eigenvectors for this problem is 


1] [0 0 
0}, }1/3],] 0 
of} | o} [-1/3 . 
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We know that if a matrix has a full set of eigenvectors, then those eigenvec- 
tors are linearly independent. This was crucial for us to write a fundamental 
set of solutions of x’ = Ax. We are fortunate that a similar thing holds for a 
set of chain vectors that arise from the eigenvector v. 


THEOREM 5.6.2 

Let v be an eigenvector of A corresponding to the repeated eigenvalue 
and let {v, ui, U2,--- ,uz—1} be the resulting chain of generalized eigen- 
vectors. Then {v, uj, U2,--- , U,—1} is linearly independent. 


We now state the theorem for solving x’ = Ax when a chain of generalized 
eigenvectors is present. 


THEOREM 5.6.3 
Consider the system x’ = Ax for the k x k matrix A in which (i) A 
is an eigenvalue of multiplicity & with a single eigenvector v and (ii) 
{v,uj,--+ ,uz—1} is the corresponding chain of generalized eigenvectors. 
Set 
2G = tev et 
2 


Se = a ie Gye U5 
¢k-1 tk-2 k 
Xp-1 = = ne 4. Te yeu eeete Wee oe oa 
Then e*'v, x,,--- ,X,_1 are linearly independent and the general solution 


to x’ = Ax can be written as 


At 
= CIE WP Gil sp GRE Fp 99° a Ree ile 


Remark 1: If we had multiple eigenvectors that gave rise to the full set of 
generalized eigenvectors, then the above theorem would apply to each set of 
eigenvectors and corresponding generalized eigenvectors. 

Remark 2: If we also have distinct real eigenvalues, Theorem 5.5.1 applies 
to those eigenvalues and corresponding eigenvectors. 


| Example 3: | Find the general solution of 


= 2 —A4 
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Solution 
Because the matrix is upper triangular, we can read the eigenvalues imme- 
diately from the diagonal and see that 4 = —1 occurs three times. To find 


eigenvectors, we again need to solve (A — AI)v = 0: 


—l1- (—1) 2 —4 V11 
0 -1- (-1) 0 V21 
0 0 -1- (—1) U31 

0 2 —4 VU11 0 

0 0 0 U31 0 


The last two rows do not restrict our choices of the entries of vy. The first 
row gives 
2v21 — 403; = 0 => va1/V31 = 2: 


We can, for example, choose v21 = 2,v3,; = 1. We are free to do as we wish 
with the first entry v1, say, viz = 0. We could have also chosen v2; = v3, = 


0 and then vy, = 1 (or any other non-zero number). Thus, we have two 
eigenvectors 
0 1 
Vi= 2 ; V2= 0 
1 0 


We obtain the generalized eigenvector (or chain vector) by solving (A — 
(—1)IT)u; = v2 for u,. (Note that we cannot solve this system if we put v1 
on the right-hand side.) This gives us 


2u2, — 4u3; = 1 where => ug] = 1/2, u31 = 0 


is one possibility. We are again free to choose ui, as anything, so we let 
U11 = 0. Thus 
0 
uy = 1/2 
0 


We can thus write the general solution as 


x = cye 'vy + cge've + €3(te *v2 +e *uy) 


0 1 1 0 
=cye*|2}] +ceoe* | 0] +c3 |te* | 0} +e* 11/2] ]. (5.82) 
I 0 0 0 


Solving x’ = Ax via Jordan Canonical Form 


We saw in Section 5.4, that being able to write A in its eigencoordinates 
greatly simplified our solution to the differential equation x’ = Ax. In doing 
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so, we used u; to represent the eigencoordinates, solved the system u’ = Au 
for u, and converted back to our original variable via x = Vu. We will be 
able to state a similar result for matrices that are written in Jordan Canonical 
Form (sometimes called Jordan Normal Form). 


We begin with the observation that if A is a k x k matrix, then the chain 
of generalized eigenvectors is a basis of R*’. The Jordan Canonical Form of 
a matrix that we seek is the closest to diagonal that we will be able to find. 
For each eigenvector v; that is the bottom of a chain of length k, we have an 
associated Jordan block of the form 


i 1 0 0 0 
i dy 0 
Jy, = : 9 (5.83) 
0 0 et 
0 0 0% 1 
0 0 Oo Oo % 


These Jordan blocks combine together to form a matrix in Jordan Canonical 
Form in which the only potential non-zero entries are on the diagonal and the 
superdiagonal lying just above this: 


Jv, 0 0 
ia) oe (5.84) 
_ : 
0 0 Jy 


If a given eigenvalue of multiplicity m has a full set of m eigenvectors, then 
the corresponding block will simply be diagonal (with 0 on the superdiagonal 
entries). In Section 5.4, we saw that we could diagonalize A with the matrix 
V in which the columns were the eigenvectors via A = VAV~*. The result 
for generalized eigenvectors is analogous. We state the result for a single chain 
of generalized eigenvectors and will simply state that for the general Jordan 
Canonical Form, we will need to combine the various blocks together as in 
(5.84). 


THEOREM 5.6.4 


Suppose A is a k x k matrix with a single eigenvector v and a single 
eigenvalue of multiplicity k with {v, uj, uz, u,_1} being the resulting 
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chain of generalized eigenvectors. Set 


nw il @ ees @ 
0 A I oo 
PS | |i. | eer | and Ji |: 2 a (G85) 
0 0 a» dl 
0 0 A 


where P is a k x k matrix with the generalized eigenvectors as columns 
and J isa k x k Jordan block. Then 


A—PIPs. (5.86) 


We consider an example to illustrate the theorem. 


SVS > Consider the matrix and chain of generalized eigenvectors from 
Example 2: 


2 3 0 1 0 0 
A=]0 2 -1|,¢]o0],/1/3],| 0 
7 @ 2 0 0 =1./3 


Verify that A = PJP~' where P,J are defined as in Theorem 5.6.4. 


Solution 
We write P and then calculate P7!: 
i @ 10 0 
P=|0 4} O0|=>P't=]0 3 0 
0 0 = 00 -3 
We then have 
1 Oo] /2 to) fio 6 [es 
0% O};/0 2 1/}/0 3 O}=]0 2 -1 
00 $=] [0 0 2}|0 0 -3 00 2 
—_ eS ees SS 
P J pi A a 


Now that we have a relationship between A and J, we can consider how 
to solve w’ = Jw (where we use w; to represent the coordinates when we 
consider a system in its Jordan Canonical Form). We consider the 2 x 2 case 


as motivation: 
/ J A 1 
0 r - 


We see that is the eigenvalue of J and there is only one corresponding 
eigenvector, v = [1 0]7. We can calculate the additional vector in the chain 


378 Chapter 5. Fundamentals of Systems of Differential Eqns 


as u; = [0 1)”. We now consider the individual differential equations, 


Aw, + we (5.87) 
We = Awa. (5.88) 


/ 
Wy 


The last equation (5.88) can be solved easily as w2 = cye**. We can then 
substitute this into (5.87) to obtain 


wi = Aw, + c2e™. 


This equation is linear and can be solved with the methods of Section 1.3 to 
obtain w; = c,e*! + cote*’. Putting the solution in vector form gives 


M M 
w= | a ha noe | = ce | + ce H (5.89) 


we coe™ 
1 0 1 
= ce | + coe H + cote® | (5.90) 
= cye*v + co(e*u + tev). (5.91) 


The method we used to solve the 2 x 2 case extends to any k x k Jordan block 
since the structure remains the same. This method of solution is the motiva- 
tion for Theorem 5.6.3 (applying to a general A) and its Corollary (applying 
to Jordan matrix J). 


THEOREM 5.6.5 
Consider the system w’ = Jw for the k x k Jordan block J in which ) is 
an eigenvalue of multiplicity & with a single eigenvector v. Then 


1 0 0 

0 1 0 
VS ,>u, = ‘ mo GUS = 

0 0 il 


is a corresponding chain of generalized eigenvectors. The general solution 
can be written as 


k-2 k-1 
WS pres a i 
W1 ° (Ei 
we " QO it ¢ ; e 
ei =e neg t 2 (5.92) 
Wk 1 if Ck 
0 0 0 il 


Note that the full set of generalized eigenvectors in Theorem 5.6.5 is just 
the standard basis, often denoted e1, e2,...,@,. Theorems 5.6.5 and 5.6.6 
give a convenient form for solving x’ = Ax. 
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THEOREM 5.6.6 

Consider the system x’ = Ax for the k x k matrix A in which (i) 
is an eigenvalue of multiplicity k with a single eigenvector v and (ii) 
{v,ui,:-: ,uz—1} is the corresponding chain of generalized eigenvectors. 
Set P to be the matrix containing the chain of generalized eigenvectors 
as its columns (as defined in Theorem 5.6.4). Then the general solution 
can be written 


tk-2 k-1 
1 ¢ (k—2)! (k—1)! 
OR) Cy 
r5 . QO it ¢ : e 
: Pe 2 rol te 5.93 
0 t es (5.93) 
vk iL if Ck 
0 © 0 1 


| Example 5: | Consider the matrices A and P from Example 4: 


23 O 1 0 O 
A=|0 2 -1/, P=|0 3 0 
00 2 0 0 =}. 
Use Theorem 5.6.6 to solve x’ = Ax. 
Solution 
This is a direct application of Theorem 5.6.6: 
Ly i a is Cy 
t2|=Pe“| 0 1 #¢] Je (5.94) 
x3 0 0 1 C3 
i 9 1¢ €)fa 
= ert 0 $ 0 0 1 t C2 (5.95) 
00 => 00 1] Les 
dl of = Cy cy tet + og 4 
= 0 3 xt cf|= C23 + c35t : (5.96) 
0 0 =} C3 c3 == a 


We stated in (5.84) that we combine Jordan blocks together to give us the 
complete Jordan Canonical Form of a matrix. The size of each Jordan block 
Jy, in (5.84) is the dimension of each respective set of chain vectors and the 
total number of blocks in J is the total number of these sets. If we allow 
for complex eigenvalues, then every matrix can be decomposed into Jordan 
Canonical Form. However, for our study of differential equations, we will 
keep our focus on Jordan blocks that are of size 3 x 3 or lower, arising from 
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real repeated eigenvalues, and will refer the interested reader to an advanced 
linear algebra text such as [23],[52] for further study. As such, we finish with 
a classification system that will allow us to apply Theorem 5.6.6. 


THEOREM 5.6.7 Jordan Canonical Form 
Let A be a matrix with real eigenvalue \ of multiplicity 1, 2, or 3. 
1. If A is an eigenvalue of A of multiplicity 1, then there is one corre- 
sponding 1 x 1 Jordan block. 
2. If A is an eigenvalue of A of multiplicity 2, then one of two possibil- 
ities occur: 
(a) there are two associated eigenvectors and thus two 1x1 Jordan 
blocks. 
(b) there is only one associated eigenvector with corresponding 
chain vector set {v, u}; there is one 2 x 2 Jordan block. 
3. If \ is an eigenvalue of A of multiplicity 3, then one of three possi- 
bilities occur: 
(a) there are three associated eigenvectors and thus three 1 x 1 
Jordan blocks. 
(b) there are two associated eigenvectors, one of which gives rise 
to a generalized eigenvector; denote these as v, and {vo, w?)}, 


Then vj gives rise to one 1 x 1 Jordan block and {vo, a} 
gives rise to one 2 x 2 Jordan block. 

(c) there is only one associated eigenvector with corresponding 
chain vector set {v,u , U2}. This gives rise to one 3x3 Jordan 


block. 
| Example 6: | © In Example 3, we considered 
—-1 2 —-4 
x’= 1! 0 —1 0 x 
0 0 —1 
0 1 
and found that it had two eigenvectors: v; = |2], v2 = |0]. We also 
1 0 
found that v2 is the eigenvector that gives rise to the generalized eigenvector 
0 
uy = $ 
0 


Write the Jordan Canonical Form of this system and use Theorem 5.6.7 re- 
solve the problem. 


Solution 
Because 4 = —1 is of multiplicity 3 and we have two eigenvectors, we are 
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in 3(b) of Theorem 5.6.7. The Jordan block from v; is simply the 1 x 1 
block Jy, = —1. The Jordan block from the chain of generalized eigenvectors 


{vo, u\?)} is the 2 x 2 block 


Combining these together gives 
—{Jv, Of _ 
= | 0 al - 


0 
=| =r 2s (5.97) 


where we initially put the horizontal and vertical lines inside the matrix to 
highlight its block structure. In order to apply Theorem 5.6.6, we put the 
generalized eigenvectors in the same order as the corresponding block in J. 
Since we put the 1x 1 block first, the first column of P will be v, with v2, u\?) 
being the second and third columns: 


Od -20 
P=] 2.0 ¢ 
1 0 0 
We apply Theorem 5.6.6 to the two Jordan blocks to obtain 
r1 e' | 0 0 Gi 
rq| =P 0 |le-t te-t C2 (5.98) 
i 0/0 et|t® 
0 1 0 e’ Q 0 C1 
=!] 2 0 $ 0 e% te C2 (5.99) 
10 0 0 0 et C3 
0 e! tet Cy 
=| 2e% 0 je *!] |e (5.100) 
e' QO 0 C3 
0 1 t 
=cje'|2| +e,e7' | 0} +e3e7! | 5 (5.101) 
1 0 0 
This answer is the same as the one we previously obtained: 
x= ce ‘v1 + c2e ‘ve + €3(te 've +e *u1). = 
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Problems 


In Problems 1-12, find the eigenvalues and eigenvector of the coefficient ma- 
trix by hand (the eigenvalues are all repeated with only one eigenvector). Use 
the methods of this section to obtain a generalized eigenvector. Then use 
Theorem 5.6.3 and Theorem 5.5.3 to write the general solution. 


av =ax2+2y gv =-—3a+y uv’ = 7x —2y 
La De ea 

y=y y = —3y y =8r-y 

av =-3x+y gv =-2e+y w=y 
Cea eee By ha oi 

xv =-ar+A4y vy =-24-—y vw =a-—2y 
. ee ee 9 Ly! = Qe — By 

wv =—3r-y vw =—x—-2y av =Te+y 
oe Te ae os (224 


In Problems 13-21, use MATLAB, Maple, or Mathematica (or by hand, if 
instructed) to find the eigenvalues and eigenvector of the coefficient matrix 
(there is a repeated eigenvalue with only one corresponding eigenvector). Use 
the methods of this section to obtain a generalized eigenvector. Then use 
Theorem 5.6.3 and Theorem 5.5.3 to write the general solution. 


a =au-y-Z a =2Qe+y a =-r+y+z 
13.4 y =a4+3y+2 14.¢y'=y 15. < y! =3y4+2z 
i — 2 z =at+3y42z zg =—dy—z 
az’ = 5x — 4y ge = 22 vw =Qe+ytz 
16. <¢ y/ =x7+2z 17. < y/ = 2y 18. ¢ wy =y-2z 
2’ = 2y4+ Bz zg =atyt2z zg =xat2y4 32 
= wv =4¢4—y wv =a+z 
19.4 y =—2y—z 20. 4 y/ =4z 21. ¢ y! =2a —y—3z 
2g =e+y—2 2 =2Qa-—yt2z g=-—ae+y4+3z 


In Problems 22-23, write the general solution for x’ = Ax, where A is the 
given matrix. 


1 0 0 0 0 0 1 0 0 0 0 0 
03 00 0 0 0 2 1 0 0 0 
003 0 0 0 00 2 0 0 0 
oe 000 3 1 0 a 000 3 1 °0 
000 03 1 000 03 1 
000 00 3 000 0 0 3 
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24. Find the Jordan normal form of 


7 =6 2 5 ye ee 
§ =< 3 7 5 —10 
“4 46 <d =8& 2@ a 
ATG 0 0 9 0 2 
5 =k 3 4 5 | =F 
6° 00 =F =§ =4 19 


You may use MATLAB, Maple, or Mathematica to find the eigenvectors 
and help you find the generalized eigenvectors. How many Jordan blocks 
do you have? What is the size of each one? Now experiment with the 
built-in commands in each of the three that will find the Jordan normal 
form for you. Is the computer answer different from yours? Explain. 


5.7 Matrix Exponentials 


As with most of the sections in this chapter, we have been considering the 
first-order linear system (5.1), which can be written in matrix notation as 


x’ = Ax. (5.102) 


In Section 5.4, we saw that x = e*v is a solution to (5.102) provided that 
A is an eigenvalue of A with v as the corresponding eigenvector. We know 
that solutions are unique, but is this the only form in which we can write the 
solution? The answer is “no” for reasons we will see shortly. For the moment 
let us suppose that it makes sense to write 


et (5.103) 


where A is the matrix in (5.102). And further suppose that it makes sense 
to take the derivative of this function in the same way we take a derivative of 
the function e** when a is a constant; that is, (e%)’ = ae’. We thus suppose 
that it also makes sense to take the derivative as follows: 


d 
7 lena Ae (5.104) 
If we assume a solution of the form x = e*’, then 
x’ = Ac* 


and substitution into (5.102) shows that both sides of the equation are indeed 
the same for all t. By our previous definitions, this means that e“* is a so- 
lution. We thus have another form of a solution provided it makes sense to 
exponentiate a matrix and then take its derivative. 
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Formal Definition and Properties 
We make the following definition of a matrix exponential to help us. 


Definition 5.7.1 


For any square matrix A, define 


K- &e — AR 
A _ = 
e Slat ape =) —. (5.105) 


For our purposes, we often consider e“*. Because a scalar times a matrix 


is just another matrix, the above definition gives us 


At A??? OS ARE 

At _ tee 

ew’ =T+ 7 + aI + = 
k=0 


(5.106) 


The reader should note that this definition of the matrix exponential is in the 
form of an infinite series. It turns out that this series converges for any matrix 
A and thus it makes sense to talk about e“ or e“! for any square matrix A. 

In the case of a diagonal matrix, our computation is particularly easy as we 
see in the next example. 


BEV SOSSE) Compute eA! for A = : be 


Solution 
In order to apply (5.106), we need to calculate the successive powers of A: 
Te 2 {4 0 x [2 0 
aa|i Zils 2), al ek (—1)* | ° 


Applying (5.106) gives 


co 


ie - ? =2/| Sat Gy 0 _fe* 0 
es 2°78 (0) me a 0 (-1t)* | =] 0 ent i” 


k=0 20 k! 


This example about a 2 x 2 matrix can be generalized for a diagonal matrix 


of any size: 
d, 0O--- 0] ie 0 ::- 0 | 
0 do: 0 0 edat ... 0 
for A= |. . , we have e“! = : 
0 0 dy 0 0 ednt 
(5.107) 


We state a few useful results that will help give us insight into the solution 
of a differential equation. 
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THEOREM 5.7.1 

Let A, B,P be n x n matrices with P invertible. Then 

(a) e~* = (e4)“1. 

(b) If A = PBP~!, then e* = Pe®P“!. 

(c) If A and B commute (that is, AB = BA), then e4+® = e4c®. 


Show that ete) = eAte Ato, 


Solution 
Part (c) of the above theorem applies if we can show that At and —Ato 
commute. Using some of the properties of matrices, we have 


(At)(—Ato) = (AA) (—tto) = (AA)(—tot) = (—Ato)(At), 
which shows that the matrices do commute. Part (c) of the above theorem 


then gives us our desired conclusion. = 


Although the theorem gives some useful properties, it does not tell us how 
to compute the series for the matrix exponential. In Section 5.4, we saw that 
if A has a full set of eigenvectors we can put the eigenvectors as the columns 
of a matrix V and the relation A = VAV~' holds. Thus, we could calculate 
e“ when A possesses a full set of eigenvectors through (b). 


| Example 3: | Consider the matrix 


—2 -1 -—2 
A= |-4 -5 2 
-5 -1 1 


Find the eigenvalues and eigenvectors and then use Theorem 5.7.1(b) to find 


en 


Solution 
We can readily calculate the eigenvalue-eigenvector pairs as 


=| 1 1 
ST | ye 642) bee <a] 
2 1 { 


Thus the matrix is diagonalizable with V containing the eigenvectors as 
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columns. Then we have 


a= Ve"V | (5.108) 
at Ye Lf @ oft a 27> 
=|1 2-1/]0 e*® oO 1 2-1 (5.109) 
2 1 1 ¢ 0 <= a | 
gee+ ze §+35e% ze ° 70° ze 3 | ze 3 
_ —ze? + Ze 6 ze 3 Ze 64 1,-3 ze° — ze ° . (5.110) 
—2¢3 + 1e-6 + 1e3 Le 6_1¢-3 23 + 1e3 


The step of calculating V~! can be done by hand using Appendix B.2 or one 


of the computer programs. = 


If we are able to write the matrix in Jordan Canonical Form via A = 
PJP~—', then we can similarly apply Theorem 5.7.1(b) to find e“; however, 
e? is not nearly as easy to calculate as e*. We refer the interested reader 
to the exercises for practice with these types of matrices. For a general ma- 


trix, the following theorem is useful for calculating the exponential of a matrix. 


THEOREM 5.7.2 


Let A be an n xX n matrix. 
a) There exist functions a(t), a2(t),...,@n(t), such that 


et Sai At es a tyA® “Co Fan At onl. 
(5.111) 
b) For the polynomial (in r) 


p(r) = ay (t)r?—! + ag (t)r® 7 +--+ + an_i(t)r+an(t), (5.112) 


if A is an eigenvalue of A, then 


so that e*! = p(At). 
c) If \ is an eigenvalue of multiplicity k, then 


We calculate e' by first applying parts (b) and (c) of the above theorem 
to generate a set of linear equations in a;. We then solve for these a; and 
substitute into the formula in (a). 


5.7. Matrix Exponentials 387 


COROLLARY 5.7.1 


a 


For a 2 x 2 matrix A = b - , we have 
AR .» |GESO silo At _ at |cosbt —sinbt 
a | sinb cosb | eM ANUS eS te | sinbt —cosbt 


Example 4: -1 -2 3 


Find e“! if A= | 0 2 —1 


Solution 
This is the case of n = 3 in part (a) of Theorem 5.7.2: 


eAt — ay (t) At? + ag(t)At + a3(t)I 
2 


-l1 -2 3 —-1 -2 3 1 0 0 
=at?}0 2 -—1} +aot! 0 2 +a3;/0 1 0 
0 0 2 0 0 0 0 1 
ayt? —agt+az = 2at? — 2aot 5a, t? + 3aat 
= 0 day t? + 2aat + a3 = 4da;t? = Agt (5. 114) 
0 0 da, t? + 2agt + ag 


where we have stopped writing the dependence of a; on t for notational con- 
venience. The eigenvalues of A are easily seen to be Ay = —1,A2 = 2,A3 = 2. 
We thus set up a system of three equations to calculate a1,a2,a3: part (b) 
of Theorem 5.7.2 for A; and part (c) for the repeated eigenvalues A2, A3. For 
the latter situation, we have 


pir) =ayr? +agr +03, p'(r) = 2air + ay. 
This gives us 


p(2t) : e _ a, (2t)? +r a9 (2t) + ag 
p'(2t): e7! = 2ay(2t) + a2. 


For the non-repeated eigenvalue, we have 
p(—t): e * =ay,(-t)? + ae(—-t) 4+ a3. 


We solve this system of equations, for example using MATLAB, Maple, or 
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Mathematica, to obtain 


3te?* — ce? + et 


oad 902 
3te?* — 4e?* + de~* 
ind Ot 
—6te?’ + 5e?! + de~* 
a3 = 9 ‘ 


Substituting these values into (5.114), we see that 


l B3e—'  2e~* — Qe?* 4. Dte?# 4 Fert fet 
C= 3] 0 3e# — Bie” ; (5.115) 
0 0 3e7! 


We will consider one more example before showing how to use the matrix 
exponential to solve systems of differential equations. 


Example 5: SHaeup ata eee Ps ms 


Solution 
The above corollary gives us 


e 


At -t|cos2t —sin2t 
- sin2t  cos2t |° 


In determining the exponential of a matrix in the above discussion, we can 
use our computer programs to solve the system of equations that resulted by 
application of Theorem 5.7.2. For pedagogical reasons, it is useful and impor- 
tant to understand how the exponential of a matrix can actually be computed 
and the algebraic manipulations can be done with the programs. However, 
if our ultimate goal is to solve and/or gain some insight into the solution of 
a given differential equation, the matrix exponential is simply a tool that is 
at our disposal and we can simply use the built-in computer commands to 
calculate the exponential of a given matrix. 


The Derivative of the Matrix Exponential 


We motivated the matrix exponential by saying that if we could define e* 


and the derivative of it (in the “normal” manner), we would have found an- 
other expression of the solution of x’ = Ax. We formalized e“' and we now 
show that we can take its derivative in the “normal” manner. 
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THEOREM 5.7.3 


Remark: Note that this theorem shows that A commutes with eA* 


Proof: The proof of this is straightforward and uses the definition of limits 
and series formulation of the matrix exponential discussed in the previous 


section. 
a cA(t+h) _ pAt 
ae | = fm | h 
cAteAh _ eAt 
= lim a by Theorem 5.7.1 
h-0 h 
Ah 
reer en? —T 
= 1 
. jim, | h | 
Ah A?h?— Akh 
I+ + poses I 
ALi: 1! 2! 3! 
=e lim 
h-0 h 
AS. Ath Ae 
— At}; ae 
= tim, | a 7 ar T | 
= eAtA (5.116) 


This proves the first equality. For the second, we only need to observe that 
A commutes with each term of the series of e“'. That is, 


Ah A?h? Ash 
At _ | ved 

A?h Akh? Ath 

7 - oe +] 

_ _AhA | AZn7A ; APRA 

7 ic > Br 

272 33 
A eee 
3! 
=e“ (5.117) 
The theorem is thus proved. 
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Example 6 Show that e“* is a solution of x’ = Ax for A = EB 7 | : 


2 -1 


Solution 
This matrix was considered in Example 5 of this section and we found that 


At -t COs 2t = sin 2t 
ss sin2t cos 2t 


For the derivative, we have 


[eAt]’ — et cos2t —sin2t _,|—2sin2t —2cos2t 
. > sin2t cos 2t 2cos2t —2sin2t 


_ 4} —cos2t—2sin2t — sin 2t — 2 cos 2t 
= eee — cos 2¢— 2sin 2t | ° oats) 
Calculating Ae“', we have 
-1 -2 cos2t —sin2¢ 
At _ —t 
ae = | 2 “ie ee cos 2t | 
4] —cos2t—2sin2¢ sin 2t — 2cos 2t 
— Paes — cop 2t—2einge |? 419) 
which shows that e“‘ is a solution. - 


Thus for a homogeneous constant coefficient system of equations x’ = Ax, 
we have another method of finding a solution. In the next section we will see 
how this relates to our previously obtained solutions (in Sections 5.5 and 5.6), 
and then will extend this knowledge to handle situations where the coefficient 
matrix is not constant or is nonhomogeneous. 


Fundamental Matrices 
We consider the homogeneous system in the form 


x’ = Ax. 


We learned in Theorem 5.5.3 that if the vectors x;(t),x2(t),--- ,Xn(t) form 
a fundamental set of solutions on (a,b), we can write the general solution as 
a linear combination of these vectors. Equivalently, the general solution is 


sometimes written as 
x(t) = ®B(t)e (5.120) 
where 
C1 
@(t) = | xi(t) | xo(t) |... | xn(t) and c= co: | (5.121) 
Cn 
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The matrix ®(t) is called a fundamental matrix and the vertical lines sepa- 
rate the columns. If we are given an initial condition for the system x(to) = Xo, 
where a < to < 6, we must have that 


Xo = ®(to)c. 


Because the matrix has linearly independent columns regardless of t (because 
the columns are the vectors in the fundamental set of solutions), we know 
®(t) is always invertible (nonsingular). Thus 


c= ®~!(to)xo. 
Substituting into (5.120) gives 
x = B&(t)B7"(to)xo. (5.122) 


What is the significance of this? In solving systems of equations using 
the matrix exponential, we had not yet considered a problem with an initial 
condition. Noting that ce’ is also a solution to x’ = Ax for any constant 
vector ¢ and also noting that e*° = I, we can see that 


Aty,. 


x’ = Ax, x(to) = Xo has solution e 

Because solutions must be unique for the constant coefficient system, we have 
eAt — &(t)B-1 (to). (5.123) 

This is another way to calculate the matrix exponential, even though we would 
want to avoid using this method in practice due to the computation involved 


in calculating a matrix inverse. More importantly, this equality shows us how 
the vectors in a fundamental set of solutions relate to the matrix exponential. 


| Example 7: | Use the fundamental matrix to find the exponential of: 
3 1 
ae | ; i | 
Solution 


We find the eigenvalue-eigenvector pairs of A are 


2 {a']} te La]: 


Then we can calculate ® as 
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To compute e4*, we need to find &~!(t9) and we take to = 0 for convenience 
(any to will work since the columns are linearly independent for all t): 


&(0) = | ; | = a(0)=5 Ee aE 


Finally, we have 


1 Qe2t 4. edt — ert 4 oot 
At _ 4 a 
ee = 6D "(0) = 3 Ee +2e5t e2t + debt a 
e e e e e t e e e e e e 


Problems 


In Problems 1-12, let A be the given matrix and then calculate eA’ without 
using the built-in computer commands. 


3. (C0 -1 0 3-2 2 1 
8%) 2[2) ofr] «fy 

1 -2 2 1 0 1 1 -1 
F —5 Bs 1 2 ts 1 0 Be 1 1 

3. 2 1 -2 -1 -3 —2 3 
ae ed ie et aA 


In Problems 13-15, let A be the given matrix and then find e“' using the 
built-in computer commands. 


-1 12 1 0 0 Loe ; re 
13..|/° 0° 1 0 14.};4 38 —3 15. 

1 0 0 2-1 1 ae 

-1 3 #0 1 

In Problems 16-18, let J be the given matrix and then calculate J?, J°, J+. 

2 1 -1 1 al 
16. Fi >| inl “1 18. i | 
19. Find J” for J = E | , 

0 a 


In Problems 20-27, let A be the given matrix and then find e“*. Then verify 
that this answer is a solution to the equation x’ = Ax. 


3-2 1 -2 2 1 Q l 
vo.[8 -2] mf 2) ef) as. 0 


1 -1 3. 2 1 -2 5 60 
24. Fi | 25. Ee | 26. F 5 | 27. B “| 
The Cayley-Hamilton theorem states that any square matrix satisfies its 


own characteristic equation. That is, if 


det(A — AL) = apA" + aA" +++ + Gn—2d? + Gn—1A + Gn (5.125) 
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is the characteristic polynomial of A, then 
agA™ + aA" —* +s ta, 9A? +4, 4A +0,1=0. (5.126) 


(Theorem 5.7.2 was obtained from this theorem.) Show the Cayley-Hamilton 
theorem holds for the matrices of Problems 28-39 (cf. Problems 1-12 of this 
section). 


3. (C0 —-1 0 3-2 2 1 
as. [2 9) [eo] [8-2] on. f2 3] 

1 -2 2 1 0 1 1 -1 
fh 3) on. [2 2) of? Pos. 


3. 2 1 -2 -1l -8 —2 3 
6/53] 97a W]e [a Ti] [G2 


5.8 Solving Linear Nonhomogeneous Systems of Equa- 
tions 


The reader should recall that Section 3.4 showed that any nth-order equa- 
tion can be converted to a system of n first-order equations. Thus the methods 
that we consider in this section apply to any linear differential equation, re- 
gardless of whether it has constant or variable coefficients or whether it is 
homogeneous or nonhomogeneous. In this section, we consider first-order sys- 
tems of the form 

x’ = A(t)x + F(t), (5.127) 


where F is a vector with continuous functions as its entries. 


Constant Coefficient, Constant Forcing 

We begin by considering (5.127) when A has constant entries and the forcing 
function F is also constant. The key for this problem is to remember that we 
need to obtain any particular solution and then add it to our homogeneous 
solution. One particular solution will occur when x’ = 0: 


0=Ax+F,=> Ax=-F. (5.128) 


This is simply Ax = b when b = —F and can be solved with Gaussian 
Elimination. Once we have obtained a particular solution, we can find the 
homogeneous solution with the methods of Sections 5.5, 5.6, or 5.7. 


| Example 1: | Solve 
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Solution 
We first look for a particular solution by setting x’ = 0 and solve: 


—2 0 4 2 
Ax=-F=>|4 2 —-4]}x=]-2]. (5.129) 
2 4 2 —4 
5 
We can solve with Gaussian elimination to obtain the solution x, = | —5 
3 


To obtain the homogeneous solution, we consider x’ = Ax and use Section 
5.5 or 5.7 to write the solution as 


1 sin(2t) 
Xp, = Gye™ = + C2 = sin(2¢) 
1 4 cos(2t) + $ sin(2t) 
cos(2t) 
+C3 — cos(2t) ; (5.130) 


=} sin(2t) + 4 cos(2t) 


with the general solution being x = xz + Xp. 


Constant Coefficient and Diagonalizable Matrix A 


At the end of Section 5.4, we discussed how switching to eigencoordinates 
allows us to solve a diagonal system in an easier form. (Appendix B.4.1 also 
discusses constant matrices that can be diagonalized in more detail.) In the 
situations where this can be done, we write the eigenvectors as columns of a 
matrix V and observe that A = V~!AV is a diagonal matrix. If we define a 
new variable y by 

x= Vy, 


then the constant coefficient nonhomogeneous system (5.127) can be written 
as 


Vy’ =AVy+F(t) = yl =V'AVy+V"'F(t) = Ay+ V7'F(t). 


This gives a system of uncoupled equations, each of which is linear and first- 
order and thus can be solved by methods of Section 1.3. 


| Example 2:| Solve 
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Solution 
We can use our computer programs to find the eigenvalues and eigenvectors 


as 
1 —2 
Ay = —3, A2 = 3, u=|a]) =[7']- 


Creating our matrix whose columns are these eigenvectors and calculating its 
inverse gives 


[ef 2 a“ Tat. 2 
v-[} 3) = ve-2[ 43. 


By defining a new variable y = V~'!x, our system becomes 
y= V'AVy + V7'F(t) 
_|-38 0 1} 1 2] |—sint 
ied (eee |e a (es ae 


_{[-3 0 1 | —sint + 2e!? 
a3 sly+3 | sint + ef |. (5.131) 


This gives the uncoupled system of linear first-order equations 


y, + 3y1 = =(—sint + 2e’) 


Clr 


yy — 3y1 = =(sint +e’). 


WwlrR 


This gives 
Y= a2 (cost — 3sint) + a +cje 
30 6 


3t 


1 
yo (— cost — 3sint) ge + C9€ 


~ 30 


We still need to write this answer in terms of the original variables. Doing so 


gives us 
1-2) /m Y1 — 2yo 
-V —4 — 
7 " E 1 1] eee 


1 1 
Tl (cost + sint) + 5° +e ea, — 2e*co 


sint 4 e ey t ees 


—3t | 1 —2 
sce] a 


+e! | + cost al +sint yk (5.132) 


0 
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The form of this solution should look familiar in that it is composed of the 
complementary solution (i.e., the solution to the system when F(t) = 0) and 


a particular solution that is determined by the function F(t). = 


Matrix Exponential 


In Section 1.3 we saw that a linear system of the form 2’ + ax = f(t) has the 
solution 


ce™ + ot fone" p(tat, 


It can be shown that an analogous formulation of this solution exists in the 
case of (5.127). Thus x’ = Ax + F(t) has solution 


x = ete + eA? ‘| e AR (t)dt. (5.133) 


(It is easiest to understand the derivation of this solution in terms of a general 
fundamental matrix and the method of variation of parameters, which we 
examine next.) If we also have an initial condition, the solution can be written 
to take this into account. Thus 


x’ = Ax+F(t), x(to) = xo (5.134) 
has solution 
t 
x = eA(&to) xg 4 cM f eA’ F(s)ds. (5.135) 
to 


We again note that the form of this solution is composed of a complementary 
solution and a particular solution. 


| Example 3: | Use the matrix exponential to solve 


Solution 
We can calculate the matrix exponential by the methods of the previous sec- 
tion or by using the computer. If we choose the latter, we see that 


‘AG 1 os ot Qe3t De 3t — ‘Ss | 


ew = = a = 
3 | e73t— e8t — 2e-3t + Bt 


We also need to calculate [ e~4'F(t)dt. We note that e~“* is easily calculated 
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from e“* by simply replacing t with —t. Then we have 
; e AtR(t)dt 


1 [ e8! + 2e-%* = Qe* — 2e-* | [ —sint 
— 3 est — ea 3t Je3t 4 e-3t et 
= —2e—3 sin t — e% sint + 2e4* — 2e—7# 
~ | 3] —e3 sint + e~* sint + e774 + Qe*# 
_ 1 | 2e7** cost + 6e~* sin t + e** cost — 3e*' sint + 5e* + 10e~”* 
~ 30] e° cost — 3e* sint — e~* cost — 3e7* sint — 5e77# + 5e** 


We then left multiply by e“! and obtain, after much simplification, 


1 [cost +sint + 5e® 
10 —2sint : 


We add this last vector to the product of e“! with an arbitrary vector. In 
the formula, we gave the arbitrary constant vector as c but for comparison 
purposes (with the previous example), we let k be our arbitrary constant 
vector. 


1 peas | | 1 | 


= 3] e-8t_ e3t  Qe-3t 4 C3t ko —2sint 


i fe + 2k2)e** + (2k — fed 1 ha +sint+ 


~ 3 | (ki + 2kg)e~** + (—ky + ka)e** 10 —2sint 


This solution is completely correct. However, so as to have the solution in the 
form given in Example 1, we let cy = (ky + 2k2)/3 and cg = (—ky + ke)/3. 
Then our answer can be written as 


= 1 —2 
x=ce ae | +e | 1 | 


+e! eal + cost ca +sint | (5.136) 


Non-Constant Coefficient Systems 

When we considered an nth-order equation with non-constant coefficients, we 
stated that there was no general formula for calculating a fundamental set of 
solutions. However, if we somehow obtained a fundamental set of solutions, 
we could solve the nonhomogeneous equation by using variation of parame- 
ters. The method of variation of parameters extends to first-order systems of 
equations. Unfortunately, so does the fact that there is no general formula 
for obtaining a fundamental set of solutions. Thus we will be able to solve 
a nonhomogeneous problem only if we somehow can obtain a fundamental 
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set of solutions. In the case when the coefficients of the matrix are periodic, 
there is a technique called Floquet theory that can help us in this quest for a 
fundamental set. But in general, we will not be so lucky. Let us begin with a 
system of the form 

x’ = A(t)x+ F(t). (5.137) 


We will assume that we somehow are able to obtain a fundamental matrix 
®(t) for the homogeneous system (i.e., when F(t) = 0). Analogous to Section 
4.5, we use variation of parameters to try to obtain a particular solution. That 
is, we try to find a vector u(t) such that 


Xp = &(t)u(t) 


is a (particular) solution. We note that the dimensions of ® and u require that 
the order of the multiplication is as given here. We will need the derivative 
of this to substitute into (5.137). Calculating this gives 


x, = ®'(t)u(t) + &(t)u'(t), 


and we again note that the order of the multiplication matters. Substitution 
into (5.137) gives us 


®'(t)u(t) + ®(t)u'(t) = A(t) ®(t)u(t) + F(t). (5.138) 
We can arrange this as 
[®’(t) — A(t) B(@)] u(t) + @()u'(t) = F(t). 
Because ®(t) is a solution, this simplifies to 
®(t)u (t) = F(0), (5.139) 


which we can solve for u’(t) since ®(t) is a fundamental matrix (and thus is 
invertible): 
u(t) = 67! (t)F(t). (5.140) 


We can, in theory, integrate both sides of this last equation and thus obtain 
u(t). In practice, this integral may be difficult to evaluate but we will still be 
able to write our solution with an integral in it. Integrating gives 


u(t) = / ®~'(t)F(t) dt, (5.141) 
and thus the particular solution is of the form 
x)= a(t) | eOF() dt. (5.142) 
The general solution to (5.137) can be written as 


x(t) = B(t)c + B(t) / ®~'(t)F(t) dt. (5.143) 
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We now use variation of parameters to solve the problems of Examples 1 and 2. 


| Example 4: | == Use variation of parameters to solve 


,_ |i —A4 4 —sint 
SNe. a e |. 
Solution 


In Example 1, we found the eigenvalues and eigenvectors to be 
1 —2 
Ai = —3, A2 = 3, Vi= il VS | 1 [> 
We can use these to create a fundamental matrix 
—3t 3t 
e — 2e 
= |e est | : 
The inverse is easily calculated because we are in the 2 x 2 case: 
il eet J2e3t 
® (i) == 
(=| Sw Bs 
Applying the formula for the solution and getting some help from our com- 
puter programs, we have 


1 { —e?' sint + 2e** 
=i es 
2oune)= 3 oe sint + e~*# 
1 e** cost — 3e%" sint + 5e** 
=] a ee 
—— Je (t)F(t) dt = 30 = cost — 3e—3t sint — 5e 2 


Left multiplication of this result by ®(¢) and lots of simplification give us 


_ 1 [cost+sint + 5e* 
1 _ 
oi) | ® RW a= Z| a |. 


Thus, from (5.143), we can write our general solution as 


= “S| [| 1 | 
x= + 


et et C2 10 —2sint 
_3 | 1 —2 
= cie ae | + coe | 1 | 
1/10 : 1/10 4 | 1/2 
+cost| 0 | + sint ea +e | 0 |: (5.144) 


As expected, this is the same answer as we obtained in Examples 1 and 2. 
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Problems 


In Problems 1-6, solve the following homogeneous systems with one (or more, 
if instructed) of the methods of this section. 


i |s Pal ate) P a s.x=[4 i 
32 1 0 —-2 -1 2 0 

ax=[5 Ac 5.x/=|]1 2 5 x 6.x/’=] 0 1 O]x 
00 -1 4 0 38 


In Problems 7-14, solve the following nonhomogeneous systems with one (or 
more, if instructed) of the methods of this section. 


,_|-3 -2 2 ,__|-5 2 1 
"o> | 3 4 x+ I 8.x = l 9 x+ 3 
; 4 0 sint ,_ | 3 2 0 
ote | >| ae 0.x =| 3 5) =+ |ccne| 
10 -2 et -1 2 0 0 
ll.x/=]1 2 5 x+ }|sint 12.x/=/]0 1 O}]|x+ ef 
00 -1 0 4 0 3 cos t 
-1 0 3 sint 0 2 1/2 0 
3.x =)/0 1 Olx+)} 0 14.x‘=]1 1 1/2|}x+] e 
1 01 et 20 2 cost 
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In Problems 1-8, determine whether the statement is true or false. If it is 
true, give reasons for your answer. If it is false, give a counterexample or 
other explanation of why it is false. 


1. All linear systems of differential equations can be solved by first finding 
the eigenvalues and eigenvectors of the coefficient matrix and then taking 
a linear combination of ev; 

2. If the vectors x1, X2,...,Xn are constant vectors (i.e., with no dependence 
on t), then the Wronskian equal to zero implies that the set of vectors is 
linearly dependent. 

3. Every 2 x 3 matrix has the zero vector as the only element in its column 
space. 


4. Every 3 x 2 matrix with linearly independent columns has only the zero 


vector in its nullspace. 
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5. A linear system of differential equations with repeated complex eigenval- 
ues cannot be solved. 


6. Consider an nth-order linear differential equation (studied in Chapter 4) 
that is written as a system of first-order equations (via the methods of 
Section 3.4). The solution obtained to the nth-order equation by the 
methods of Chapter 4 is mathematically equivalent to the solution ob- 
tained by solving the system via methods of Chapter 5. 


7. One calculates the derivative of a matrix by taking the derivative of each 
element of the matrix. 


8. A basis can be found so that every matrix can be diagonalized or written 
in Jordan normal form with respect to this basis. 


In Problems 9-16, determine whether the given set forms a fundamental set 
of solutions for the given differential equation. 


® tfc] [ie]. *= [2 25) 


3e7¢ e-3 F 1 —-2 
offal (eal. #=[ <3 
ert —e&t 5 —1 
11. 1 ’ e&t |}. x! = & 4 x 
1) -a¢ |—1]| 2 [th 2 
12. {| i] ¢ leat » X=! _3 _1|* 
2) , 41] —% ,_|3 1 
mbes} ~=[2 “al 
1} ae | 1 | (se ,;_|-6 1 
14. {] ]¢ [2] » X=1y _6 x 
1 1 1 2 -2 1 
15. =I) e",|1)e,| 1 |}e*s, x=/-8 8 L)x 
1 1 —1 3 -2 0 
1 1 —1 A -2 -1 
16,<¢ }=1|e"%\1)-e,| 1 }e* >, x =)]=1 2 = 1) 
1 1 1 1 -2 2 


In Problems 17-25, determine whether the given set of vectors forms a basis 
for the specified vector space. 


veg LS] pm 64 | La) 


1 2 4 1 2 3 
21 1},; O},] 2 ,R° 22 Lg} OO Wg 22 ,R? 
0 -1 -1 0 -1 2 
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1 3 1 1 
23. 1)},/ O},/-2],] 3 ,R? 
0 1 1 1 
1 2 2 1 
24 1 0 2| Jo i 
—1]/’?]-1]’]1]?]2 of 
1 —3 2 0 
1 0 2 1 
25. | | 0 0 2) 1a P 
—1})?}-1]?}1]7)0 a 
2 1 2 0 


In Problems 26-31, find bases for the nullspace and column space of the given 
matrix. Ask your instructor if this should be done by hand or with MATLAB, 
Maple, or Mathematica. 


-1 3 —2 4 —2 0 2 
26.] 2 —6 27.| 2 —-A4 28./-4 -2 2 
-1 1 -1l 2 1 4 3 
-1 2 2 
-1 2 2 5 -—2 3 
29 | | 30. | | 31.}-1 7 8 
-1 1 2 —2 0 2 2 12 


In Problems 32-47, (i) find the eigenvalues and eigenvector of the coefficient 
matrix by hand; (ii) find two linearly independent solutions; (iii) then use 
Theorem 5.5.3 to find the general solution. Problems 32-39 have real, dis- 
tinct roots and Problems 40-47 have complex (non-real) roots. 


a2. Caan 33. a 27 34. oa 
i po i 

35. y 7! oy 36: e 7 eee 37. {y a 

2 erie a AR 
hi a _ r_ 

re eee ey nt eee 

wei Lyle” Glas, 
— 

AT. ie = oa 


In Problems 48-50, use the given substitutions to rewrite the equations as 
an uncoupled system. Then write the solution in terms of u,,u2 and use this 
to find the solution in terms of «x, y. 
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_ = : xv’ = —7Tx + 2y 
48.u1 = —5@ + 2y,ug = 34 —y for ie = —l5ax + 4y 
uv’ = —6x + 8y 
49. uj =XU—Y, U2 = —@ + 2y ae 


ae _ vw =4r-—y 
50. uy = 2a — y, Ug = —2a + 2y eet 


In Problems 51-56, find the eigenvalues and eigenvectors of the following ma- 
trices. Get clarification from your instructor as to whether you should find 
these by hand or by using MATLAB, Maple, or Mathematica. 


4 —8 —10 0 -—2 0 2 2° 1 
51. }-1 6 5 52.) 1 3. (COO 53. )/-3 3 1 

1 -8 —-7 -1 -2 1 3. -—2 0 

1 -2 2 1 -2 -1 4 -2 -1 
54. )-4 3 2 55. );—-l1 0 —1 56. };-1 3 =H 

4 -2 -1 1 1 2 1 -2 2 


For Problems 57-62, (i) find the eigenvalues and eigenvector of the coefficient 
matrix by hand (the eigenvalues are all repeated with only one eigenvector); 
(ii) obtain a generalized eigenvector; (iii) then use Theorem 5.6.3 and Theo- 
rem 5.5.3 to write the general solution. 


g=-r+y vw =at+y vu’ = Tx — Ay 
a 5B.) 0) or —by © V4 = On — by 

x’ = —4r + 12y av! = 3a + 2y vw =a+4y 
OO) fcc OM ray ee 


In Problems 63-68, use MATLAB, Maple, or Mathematica to find the eigen- 
values and eigenvectors of the coefficient matrix (there is a complex pair). 
Then use the same program to find the general solution. 


av =-a-2yt+z2 xv’ = 24 —y-—2z aw =-at+y-z 
63.4 y =2e-y+z 64.4 y =a+y+z2 65. < y’ =-y 

g=z Zz =z go =u-2Z 

vw =-a+z vw = 3a +y4 3z vw =-a+y-2 
66. <¢ y’ =-yt+2z 67. < y’ = —5a—y+3z 68. <¢ y’ =-y 

go = -y-2z zg = Ay + 2z zi =a4-—2z 


For Problems 69-80, find the eigenvalues and eigenvector (all are real-valued, 
some repeated roots) of the coefficient matrix either by hand or using MAT- 


LAB, Maple, or Mathematica. Then use the methods of Sections 5.5 or 5.6 
to obtain three linearly independent solutions and write the general solution. 
uv’ = Qe —-—Qy+z vw! = 4x — 8y — 10z 
69. ¢ y! =—3r4+3y+2 70. ¢ y! = —-a+ 6y + 5z 
2’ = 3a — 2y zg =a—8y-—Tz 
wv =ax-—2y+2z ve’ =—llx+4y 
71. ¢ y! = —4x 4+ 3y + 22 72.4 y! = 8x — 25y 
zg =4xr —2y-—2z 2! = —6r + 12y — 9z 
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x’ = —2y x’ = 2a — l6y+6z 
73.¢ y =a+3y 74.¢ y’ =—3a2 4+ 4y — 32 
g = —x-—2Qy+z z’ = —4x + 19y — 82 
vw =-a2+z gv = —8x — 8y—2z 
75. ¢ y' =—3y+2 76.4 y =—-1382r4+ lMy-z 
g=-y-Zz 2! = 12a — 15y — 6z 
wv = —5a+ Ty + 14z vw =—-2Qa+y42z 
77.6 y! = 4a — 14y — 42 78. ¢ y! = 3x — by — 6z 
2’ = 5a + 8y+4z z= -2e+y-2 
vw =Te+y+2z wv =—5a4+2y+z 
79.¢ y! = 3a + 3y— 62 80.4 yo =-a+y4+2z 
zg =-Qa+y4 82 zg! = —2a —4y —5z 


In Problems 81-88, let A be the given matrix and obtain e4* (either by hand 
or with the built-in computer commands). Then verify that this answer is a 
solution to the equation x’ = Ax. 


81. r 4 82. | 0 | 83. E 4 84. E 2 
85. E >| 86. E ; | 87. E ‘ | 88. | : 25 
In Problems 89-93, solve the following systems of equations. 
we =ax+y+3 a! =I +e a! =6r-—y+l 
80. | oar yi 90. or ay o y =d5a4+sint 
xv =2Qa-—2Qy+z a! = 4a — 8y—10z +et 
92. ¢ vy’ =-34+3y+2793.¢ yi =-a2+6y+5z+e! 
z! = 3x —2y z =x—8y—Tz+e 
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Chapter 5 Computer Lab: MATLAB 


Code on solving the linear system Ax = b with the built-in functions and 
with elementary row operations can be found at the end of Appendix B. 


MATLAB Example 1: Enter the following code that calculates the 
3 0 —2 

eigenvalues and eigenvectors of the matrix }0 1 2 
0-2 1 
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SS Glloene ell 

Ss ASS, ©, =2B3 O, th 23 Op —B, 

>> lambda=eig(A) %calculates eigenvalues of A 

> I[v,d]=eig(A) %calculates eigenvalues AND eigenvectors of A 
>> eigenvectors given as columns of v 

>> corresponding eigenvalues are on diagonal of d 

>> lambda=eig(sym(A)) Zuses sym to find and display eigenvalues 
> [v,d]=eig(sym(A)) 

>> d(1,1) “first eigenvalue of A 

>> v(:,1) corresponding first eigenvector of A 

S> Axv(:,1) 

>> d(i,1)*v(:,1) %verifies that A*v=lambda*v for first 

>> % eigenvalue-eigenvector pair; the last two 

>> answers should be identical 

SS Nar? 58) 

>> d(3,3)*v(:,3) %verifies that A*v=lambda*v for third 


MATLAB Example 2: Enter the following code that solves the ODE sys- 
tem 


g! —2—-1-2 IP 
y' | =|-4-5 2 y 
es —5-1 1 g 


subject to the IC x(0) = 2, y(0) = —1, z(0) = —3 and then plots the solutions 
vs. t. The eigenvalues of the system are real. 


> clear all 

>> A=[-2,-1,-2; -4,-5,2; -5,-1,1] 

> [v,d]=eig(sym(A)) 

SS Shy) tg el es} 

>> Type the line below on a single line, not with a <return>. 

>> soln=[exp(d(1,1)*t)*v(:,1),exp(d(2,2)*t)*v(: ,2), 
exp(d(3,3)*t)*v(: ,3)] 

>> general soln is soln*[c1l; c2; c3] 

>> soln0=subs(soln,t,0) 

SS 20=|(23 lg =e] 

>> cvals=soln0\x0 

>> vin=v(:,1)*cvals(1) 

>> v2n=v(:,2)*cvals(2) 

>> v8n=v(:,3)*cvals(3) 

>> Vmat=[vin,v2n,v3n] 

>> xvec=[exp(d(1,1)*t); exp(d(2,2)*t); exp(d(3,3)*t)] 

>> soln=Vmat*xvec {the solution to the IVP 
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>> hi=ezplot(soln(1), [0,2]); 


>> set(hi,’Color’,’m’,’LineStyle’,’:’,’LineWidth’ ,2) 
>> hold on 

>> h2=ezplot(soln(2),[0,2]); 

>> set(h2,’Color’,’b’,’LineStyle’,’-’,’LineWidth’ ,2) 


>> h3=ezplot(soln(3), [0,2]); 

>> set(h3,’Color’,’k’,’LineWidth’ ,2) 
>> axis([0 2 -400 400]) 

>> xlabel(’t’) 

>> ylabel(’Solution values’) 

SS liqeemel 2B)? 5 CB)? » "GED ?) 

>> hold off 


MATLAB Example 3: Enter the following code that solves the ODE sys- 


“ 4-2 2J6 


in which the eigenvalues of the system are complex. 


>> clear all 

>> syms t ci c2 

SS Sl pall 

> [v,d]=eig(sym(A)) 

>> real(v(:,1)) 

>> a_vec=real(v(:,1)) 

>> b_vec=imag(v(:,1)) 

>> alpha=real(d(1,1))%real part of 1st eigenvalue 

>> beta=imag(d(1,1))%imaginary part of 1st eigenvalue 

>> solnx1=exp(alpha*t) *(a_vec*cos (beta*t)-b_vec*sin(beta*t) ) 
>> solnx2=exp(alpha*t) *(a_vec*sin(beta*t)+b_vec*cos (beta*t) ) 
>> %solnxi and solnx2 are from Eq. (5.75) 

>> soln=ci*solnxi+c2*solnx2 


MATLAB Example 4: Enter the following code that solves the ODE sys- 
tem 


x! —-1 2 -4 ae 
a | =| © =1 @ y 
Zz 0 0 -1 Zz 


in which the eigenvalues of the system are real and generalized eigenvectors 
are needed. 


SS Glloeie gull 
>> syms ci c2 c3t 


SE 
= 


LE 
= 
= 


= 
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A=sym([-1,2,-4; 0,-1,0; 0,0,-1]) 

[V,E]=eig(A) 

“output for MATLAB 7.0.1 was V(:,1)=[1,0; 0,2; 0,1] 
eqA1=A-E(1,1)*eye(3,3) 

equ_vi=eqA1\V(:,1) %soln to eqA1*equ_v1=V(: ,1) 
equ_v2=eqA1\V(:,2) %soln to eqA1*equ_v2=V(: ,2) 

only V(:,1) yields an answer and so we work with equ_vi 
soln=ci*exp(E(1,1)*t)*V(: ,2)+c2*exp(E(1,1)*t)*V(: ,1) 
+c3* (t*xexp(E(1,1)*t)*V(: ,1)+exp(E(1,1)*t)*(equ_v1)) 


MATLAB Example 5: Enter the following code that uses the built-in com- 


mands to find (i) the nullspace and column space of the matrix A, (ii) the 
exponential of the matrix Bt, and (iii) the reduced-row echelon form of A, 
B, and C. See Appendix B for code that reduces a matrix to reduced-row 
echelon form using elementary row operations. 


= 
= 


= 


= 
= 
= 
= 
= 
= 
oe 
= 


I) 273 260 4 
REO 20990\ Ba 0 2 atl e— lear a AD 
et 0) (4 es tees) 


DEI2, —2, 2, 23 QB —By Qp Bs i, al, i, Ol 

null(A) Zorthonormal basis for nullspace, which is 
#useful for numerical computation 

null (A,’r’?) “this is allso a basis but is!’ easier to 
Zwork with by hand 

colspace(sym(A)) %finds a basis for the column space 
Bali 2.350, 2,—120,0,2)]| Zdefines the matrix B 
syms t; %defines t as a symbolic variable 

expm(B+t) <%calculates the matrix exponential 
CS(2,6,0,49 =—1,1,4,2¢ i,-1,—4,—2] Zdefines the matrix C 
rref (A) 

rref (B) 

rref (C) 


MATLAB Exercises 


il. 


Enter the commands given in MATLAB Example 1 and submit both your 
input and output. 
Enter the commands given in MATLAB Example 2 and submit both your 
input and output. 
Enter the commands given in MATLAB Example 3 and submit both your 
input and output. 


Enter the commands given in MATLAB Example 4 and submit both your 
input and output. 


408 


10. 


11. 


I, 


13. 


14. 


15. 


16. 


17. 
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. Enter the commands given in MATLAB Example 5 and submit both your 


input and output. 
3 10 


. Find the eigenvalues and eigenvectors of | 2 4 0 


3 =I il 


. Find the eigenvalues and eigenvectors of the following matrices: 


ae 
meee 


Shh3 


. el 


B 


. Find the eigenvalues and eigenvectors of the following matrices: 


a= [5 3) B-[7 75) 


. Find the eigenvalues and eigenvectors of the following matrices: 


—2 2 O 1 -—-5 -1l 
|e TN eS ea 
—10/3 5/3 1 0 O 1 
Solve the ODE system in which the eigenvalues are real with a full set of 
vu’ =—-4r-—y 
y’ =6r+y 
Solve the ODE system in which the eigenvalues are real with a full set of 
e =5r—y 
y =3r+y 
Solve the ODE system in which the eigenvalues are real with a full set of 
i = ete yy 
eigenvectors: ¢ y/! = 2a + 4y 
2 =3a-—ytz2 
Solve the ODE system in which the eigenvalues are real with a full set of 
gv =—-%-2y+z 
eigenvectors:{ y! = 2% —y+z 
ae? 


eigenvectors: 


eigenvectors: { 


ae! 5-1] }2 
Solve the ODE system, F| = E 3 | is 


are real with a full set of eigenvectors, subject to the IC (0) = 0, y(0) = 2 
and then plot the solutions vs. t. 


| , in which the eigenvalues 


Solve the ODE system in which the eigenvalues are complex: 
vw! = —4a + 2y 
ee —— 10g Ay 
Solve the ODE system in which the eigenvalues are complex: 
uv’ = —Tx — dy 


y’ = 107 + 5y 
Solve the ODE system in which you will need to first find the generalized 
: ae = Tap = Dy 
eigenvectors: 


yo =8r-y 


18. 


i), 


20. 


Pale 


DOr 


pee 


24. 


25. 


26. 
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Solve the ODE system in which you will need to first find the generalized 


ee=—2e+y 
eigenvectors: , 
y =-2« 


Solve the ODE system in which you will need to first find the generalized 


vw =u-—y-2z 
y =x+3yt+z 
al = 2 


eigenvectors: 


Solve the ODE system in which you will need to first find the generalized 


vw =—x+yt+z 


eigenvectors: ¢ y’ = 3y+z 
zg =—-dy—z 
Find the (i) nullspace, (ii) column space, 
2 @ —-2 -1 
formof |}0 —3 1 0 


0 0 2 2 


Find the (i) nullspace, (ii) column space, 
1 3 —6 0 
Oo =2 1 1 
Find the (i) nullspace, (ii) column space, 


2 3 =3 
formof }0 1 —-1 2 
3 i —2 
Find the (i) nullspace, (ii) column space, 
—2 4 -3 0O 
formof |} 1 1 -—-1 £5 
5 i @ —5 
Find the (i) nullspace, (ii) column space, 
—2 4 O 2 
form of | 1 i 8 2 
1 —-1 1 0 


Find the (i) nullspace, (ii) column space, 
2 6 0 4 

form of | —1 1 4 2 

il = 


i =a =2 


and (iii) reduced-row echelon 


and (iii) reduced-row echelon 


and (iii) reduced-row echelon 


and (iii) reduced-row echelon 


and (iii) reduced-row echelon 


and (iii) reduced-row echelon 
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Maple Example 1: Enter the following code that calculates the eigenvalues 


3 0 -2 
and eigenvectors of the matrix }0 1 2 
0-2 1 
restart 
with(LinearAlgebra) : 


A := Matriz(|[3, 0, —2], [0, 1, 2], (0, —2, 1]]) 

#We first calculate the eigenvalues by finding the roots of the characteristic 
polynomial. Then we show the quicker way to do this using the built-in 
Maple functions. 

eq1 := CharacteristicPolynomial(A, ) 

solve(eq1, ) 

Eigenvalues(A) #calculates eigenvalues more efficiently 

Eigenvectors(A) #calculates eigenvalues AND eigenvectors with the 

eigenvectors being the columns of the matrix 

eq? := Eigenvectors(A, output = list?) Calculates eigenvalues and 
eigenvectors; answer is a set with elements (i) the eigenvalue, 

(it) its multiplicity, (iti) the corresponding set of eigenvector(s) 
lambdal := eq2[1\[1] #This is the first eigenvalue 

eqZ[1][3] #This is the SET that contains the corresponding eigenvector 

vl := egZ[1][3][1] This is the actual eigenvector 

Multiply(A, v1) 

lambdal- v1 #These last two answers should be identical 

lambda’ := eq2[3][1] #This is the third eigenvalue 

v3 := eq2[3][3][1] This is the corresponding eigenvector 

Multiply(A, v3) 

lambda8- v3 #These last two answers should be identical 


Maple Example 2: Enter the following code that solves the ODE system 


x —2-1-2 AB 
y’| =|-4-5 2 y 
ee —-5-11 eZ 


subject to the IC x(0) = 2, y(0) = —1, z(0) = —3 and then plots the solutions 
Vs. b. 


restart 

with( LinearAlgebra) : 

A := Matriz(|[—2, —1, —2], [—4, —5, 2], [—5, —1, 1]]) 

eqEV := Higenvectors(A) 

solnta:= e 42 VINE). Column(eqEV[2\,1) #e is from palette! 
solntb := e& @# VP]. Column(eqEV[2I, 2) 
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solntc := e& 2 VUE] . Column(eqEV[2\, 3) 
gensoln := c, - solnta+ cg: soln1b+ cz - solnic 
ODEO := subs(t = 0, { gensoln|1] = 2, gensoln|2] = —1, gensoln|3] = —3}) 
cvals := solve( ODEO, {c1, C2, c3}) 
xsoln := subs(cvals, gensoln|1]) 
ysoln := subs(cvals, gensoln{2]) 
zsoln := subs(cvals, gensoln|3}) 
plot (|asoln,ysoln,zsoln|, t = 0..2, —400..400, linestyle = [1, 2, 3], 
legend = ["x(t)", "y(t)", "2(t)"]) 


Maple Example 3: Enter the following code that solves the ODE system 


Pl-[ a] [5] 


in which the eigenvalues of the system are complex. 


restart 

with(LinearAlgebra) : 

A := Matriz([|—1, —2], [2, -1]]) 

eq1 := Eigenvectors(A) 

eqd(1][1] 

eqd(1][2| 

avec := Re( Column(eq1[2}, 1)) 

buec := Im( Column(eq1[2], 1)) 

a := Re(eq1[1][1]) 

8 = Im(eaai{1) 

solnx1 := e*" - (avec: cos(8 - t) — buec- sin(G - t)) 
solnx2 := e** - (avec: sin(8 - t) + buec- cos(B - t)) 
soln := c, - solnaz1 + co - solnx2 


Maple Example 4: Enter the following code that solves the ODE system 


Gl —1 2 -4 a 
wy | =| © = © y 
ch 0 Oo -1 Z 


in which the eigenvalues of the system are real and generalized eigenvectors 
are needed. 


restart 
with( LinearAlgebra) : 
A := Matriz(|[—1, 2, —4], [0, —1, 0], [0, 0, —1]]) 
#Maple 16 gave [/0,1,0],[2,0,0],[1,0,0]/ as matrix of eigenvectors 
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eq1 := Eigenvectors(A) 

Al := A— DiagonalMatrix(eq1[1]) 

vy := Column(eq1[2], 1) 

Uy, := LinearSolve(A 1, v1) 
#with the above order of eigenvectors, Maple 18 gave an error because the 
system is inconsistent and can’t be solved; 2nd column works in next line 

v2 := Column(eq1[2], 2) 

Uyg := LinearSolve(A1, v2) 

Uy := subs(\_t0, = 0, \_t03 = 0, uve) 

soln := c, -e°UMIN + .y, 4+ eee * . gy. 4 3 - (Ge ec. + e+. u1) 


Maple Example 5: Enter the following code that uses the built-in com- 
mands to find (i) the nullspace and column space of the matrix A, (ii) the 
exponential of the matrix Bt, and (iii) the reduced-row echelon form of A, 
B, and C. See Appendix B for code that reduces a matrix to reduced-row 
echelon form using elementary row operations. 


22 BD =i =2 3 2 6 0 4 
IN pp es ieee oe (sere Sh ae 
L=1i@ 0 0 2 iL =i =a —2 
restart 
with(LinearAlgebra) : 
A:= Matrix(([2, —2, 2, 2], (2, 2, 2, 2], [1, -1, 1, 0]]) 
NullSpace(A) 
ColumnSpace( A) 


B := Matriz(|[—1, —2, 3], [0, 2, —1], (0, 0, 2]]) 
MatrixExponential(B - t) 

C := Matria(([2, 6, 0, 4], [-— 
ReducedRowEchelonFor 
ReducedRowEchelonFor 
ReducedRowEchelonForm 


1,1, 4, 2], [1, -1, —4, —2]]) 


mall 
m/( A) 
m(B) 
(C) 


Maple Exercises 
1. Enter the commands given in Maple Example 1 and submit both your 
input and output. 

2. Enter the commands given in Maple Example 2 and submit both your 
input and output. 

3. Enter the commands given in Maple Example 3 and submit both your 
input and output. 


4. Enter the commands given in Maple Example 4 and submit both your 
input and output. 


10. 


ilk, 


1, 


13. 


14. 


15. 


16. 


Wie 
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. Enter the commands given in Maple Example 5 and submit both your 


input and output. 


3 i 
. Find the eigenvalues and eigenvectors of | 2 4 0 
3-11 
. Find the eigenvalues and eigenvectors of the following matrices: 
IL il § 
= iL 2° BS 3 1 


. Find the eigenvalues and eigenvectors of the following matrices: 


Sip el al 


. Find the eigenvalues and eigenvectors of the following matrices: 


—2 (i) 1 -5 -1 
ie || Oo Pal et 
—10/3 5/3 1 0 0 il 
Solve the ODE system in which the eigenvalues are real with a full set of 
eigenvectors: 7 See. 
y = Ov 4 a) 
Solve the ODE system in which the eigenvalues are real with a full set of 
eigenvectors: om ae 
y' =3n+y 
Solve the ODE system in which the eigenvalues are real with a full set of 
ae! = Bye toy 


eigenvectors: ¢ y! = 2x7 +4y 
zg =3r-—ytz 

Solve the ODE system in which the eigenvalues are real with a full set of 

a =—x-—2Q+z 
eigenvectors:< y/ = 2” —y + z 

i ey 
5 =I || || a 
0 3 y 
are real with a full set of eigenvectors, subject to the IC x(0) = 0, y(0) = 2 
and then plot the solutions vs. t. 


ff 
Solve the ODE system, FA = | , in which the eigenvalues 


Solve the ODE system in which the eigenvalues are complex: 
vw! = —4a + 2y 
y’ = —10x + 4y 

Solve the ODE system in which the eigenvalues are complex: 
ie = Tae = Aly 


y’ = 10x + 5y 
Solve the ODE system in which you will need to first find the generalized 
: vw’ = 7x — 2y 
eigenvectors: 


Se 
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18. 


119). 


20. 


all 


De 


Dd. 


24. 


25. 


26. 
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Solve the ODE system in which you will need to first find the generalized 
: { fo rey 
eigenvectors: } 
— 
Solve the ODE system in which you will need to first find the generalized 
ev ="2-—y-zZz 
eigenvectors: ¢ y’ =x+3y+z 
ay =z 
Solve the ODE system in which you will need to first find the generalized 
vw =—x+ytz 
eigenvectors: ¢ y/ = 3y+z 
2’ =—-dy—z 
Find the (i) nullspace, (ii) column space, and (iii) reduced-row echelon 
2 6 -2 -1 
formof |0 -—3 1 0 
0 0 2, 2 


Find the (i) nullspace, (ii) column space, and (iii) reduced-row echelon 
Il 8 —6 0 
O =2 i 
Find the (i) nullspace, (ii) column space, and (iii) reduced-row echelon 


form of 


28 =3 
formof}0 1 —-1 2 
3 1 O =2 
Find the (i) nullspace, (ii) column space, and (iii) reduced-row echelon 
=4 4 = 3 
form of || I il =i ® 
5 il © —5 
Find the (i) nullspace, (ii) column space, and (iii) reduced-row echelon 
=2 4 @ 2 
form of | 1 il 3 2 
| Mail 


Find the (i) nullspace, (ii) column space, and (iii) reduced-row echelon 
2 6 0 4 

form of ;}—1 1 4 2 

io o=-il =4 =2 
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Mathematica Example 1: Enter the following code that calculates the 


a Q =2 
eigenvalues and eigenvectors of the matrix |0 1 2 
0-2 1 
Quit|] 
A= 418, 0, -2), 40, 1, 2), {0, =2, 1)) 
A//MatrixForm 
MatrixForm[A] 


eqi = CharacteristicPolynomial[A, A] 
Solve[eqi==0, A] 

lam = Eigenvalues [A] 

evs = Eigenvectors[A] 

evs[[1]] (*first eigenvector*) 

A.evs[[1]] (*matrix times eigenvector*) 
lam[[1]] evs[[1]] (*should be same as above*) 
A.evs[[3]] 

lam[[3]] evs[[3]] (*should be same as above*) 


Mathematica Example 2: Enter the following code that solves the ODE 
system 


g! —2-1-2 90 
y' | =|-4-5 2 y 
on —5-11 es 


subject to the IC x(0) = 2, y(0) = —1, z(0) = —3 and then plots the solutions 
vs. t. 


Quit|] 

(A = He, =i, 2}, {=4, By 2, 4-5, =, WD //Metiseisaitoram 
(*Note the extra parenthesis before //MatrixForm *) 
(*This allows calculations to be done on A*) 

eqEV = Eigensystem[A] 

solnia = e* e#VMHI[[] egkv[[2]] [[1]] 

solnib = e* e#VMMI[2I] egkv[ [21] [[21] 

solnic = e* e#VIMII[8] egkv[ [21] [[3]] 

gensoln = cisolnia + c2solnib + c3solnic 

ODEO = ReplaceAll[{gensoln[[1]]==2, gensoln[[2]]==-1, 
gensoln[[3]]==-3}, t—0] 

cvals = Solve[ODEO, {c1, c2, c3}] 

cvals[[1]] 

xsoln = ReplaceAll[gensoln[[1]], cvals[[1]]] 

ysoln = ReplaceAll[gensoln[[2]], cvals[[1]]] 

zsoln = ReplaceAll[gensoln[[3]], cvals[(1]]] 
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Plot[{xsoln, ysoln, zsoln}, {t, 0, 2}, PlotRange—{-400, 400}, 
PlotStyle—{Dashed, Dotted, DotDashed}, 
Plothegends (x(t) "Ch eGt i) ) 
Mathematica Example 3: Enter the following code that solves the ODE 
system 
ge | |—-1-2) |a« 
bl eal 


in which the eigenvalues of the system are complex. 


Quit| | 
AS a seh es ces 
MatrixForm[A] 


eqi = Eigensystem[A] 

eqi [[1J] ((1]] 

eqiL[1]]((2]] 

eqi [[2]] ((1]] 

avec = Re[eqi[[2]]((1]]] 

bvec = Im[egt([2]] [[1]]] 

@ = Releqi({[1]]([1]]] 

8 = Imleqi[(1]](0[1]]] 

solnxi = e“* (avecCos[Gt] - bvecSin[(t]) 
solnx2 = e“* (avecSin[(Gt] + bvecCos[/t]) 
soln = cisolnxi + c2solnx2 

Column [soln] 


Mathematica Example 4: Enter the following code that solves the ODE 
system 


x! —1 2 -4 ae 
y'| =] 0 -1 0 y 
ea 0 0 -1 g 


in which the eigenvalues of the system are real and generalized eigenvectors 
are needed. 


Quit| | 
A= {{-1, 2, -4}, {0, -1, 0}, {0, 0, -1}} 
MatrixForm[A] 
eqi = Eigensystem[A] 
(*Mathematica 10 gave {{-1,-1,-1},{{0,2,1},{1,0,0},{0,0,0}}*) 
Ai = A - DiagonalMatrix[eq1[[1]]] 
vi —eqt 02) Phau 


uvi = LinearSolve[A1, vi] (*no solution*) 


v2 
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= eqi iid tian 


uv2 = LinearSolve[A1, v2] 
soln = citecMlllty1 + caectlltlt yo + 3 (tecallillt yo + ecatlltll t yyo) 


Mathematica Example 5: Enter the following code that uses the built-in 


commands to find (i) the nullspace and column space of the matrix A, (ii) 
the exponential of the matrix Bt, and (iii) the reduced-row echelon form of 
A, B, and C. See Appendix B for code that reduces a matrix to reduced-row 
echelon form using elementary row operations. 


2 5D) =I =—2 3 2 6 0 4 
A000 |e eo 2 ile Oto ea 
i=l 1 @ 0 @ 2 i =] =a 
Quit|] 
Ne Ato, =o, 9, Ot, 1a, eB, Qh til, 1, 2, Of} 


NullSpace [A] 

MatrixForm[Transpose [RowReduce [Transpose[A]]]] 
(*non-zero columns in the above result are basis vectors 
for the column space*) 


B= 


Wile eS, Ih Oh alee HG Os, 2 


MatrixExp [Bt] //MatrixForm 


Ci 


= {{2, 6, 0, 4}, {-1, 1, 4, 2}, {1, -1, -4, -2}} 


RowReduce [A] //MatrixForm 
RowReduce[B]//MatrixForm 
RowReduce [C1] //MatrixForm 


Mathematica Exercises 


iL, 


Enter the commands given in Mathematica Example 1 and submit both 
your input and output. 
Enter the commands given in Mathematica Example 2 and submit both 
your input and output. 
Enter the commands given in Mathematica Example 3 and submit both 
your input and output. 
Enter the commands given in Mathematica Example 4 and submit both 
your input and output. 


Enter the commands given in Mathematica Example 5 and submit both 
your input and output. 

3 i @ 
Find the eigenvalues and eigenvectors of | 2 4 0 

3-11 


418 


10. 


itil, 


Ds 


13. 


14. 


15. 


16. 


if 


18. 
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. Find the eigenvalues and eigenvectors of the following matrices: 


[1 ol Bi] 


. Find the eigenvalues and eigenvectors of the following matrices: 


Sich ela 


. Find the eigenvalues and eigenvectors of the following matrices: 


—2 2 1 -5 -1l 
A= 4 0 Ol], B= il 3 il 
—10/3 5/3 1 0 O 1 

Solve the ODE system in which the eigenvalues are real with a full set of 
eigenvectors: ae a! 

8 ” | af = Ge ky 
Solve the ODE system in which the eigenvalues are real with a full set of 

ee ie gv =5r—y 
eigenvectors: one) 


Solve the ODE system in which the eigenvalues are real with a full set of 
vw =3a+y 
eigenvectors: ¢ y/ = 2a + 4y 
zg =3a-—ytz2 
Solve the ODE system in which the eigenvalues are real with a full set of 
gv =—4%—-2y+z 
eigenvectors:{ y! = 2% —y+z 
Py Neite 
ae 5-1} /a] . : : 
Solve the ODE system, i Salinas mle in which the eigenvalues 
are real with a full set of eigenvectors, subject to the IC x(0) = 0, y(0) = 2 
and then plot the solutions vs. t. 
Solve the ODE system in which the eigenvalues are complex: 
vu’ = —4a + 2y 
y’ = —10a + 4y 


Solve the ODE system in which the eigenvalues are complex: 


x’ = —Tx — dy 
y’ = 10x + 5y 
Solve the ODE system in which you will need to first find the generalized 
eigenvectors: Bie lee! 
8 ee ene, 
Solve the ODE system in which you will need to first find the generalized 
: ge =-2r+y 
eigenvectors: ; 


= = 
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Solve the ODE system in which you will need to first find the generalized 


Solve the ODE system in which you will need to first find the generalized 


19. 
vw =au-—y-2z 
eigenvectors: ¢ y! =x+3y+z 
=e 
20. 
g=—-r+y+z 
eigenvectors: ¢ y/ = 3y +z 
zg =—dy—z 
21. Find the (i) nullspace, (ii) column space, 
p; 6 —2 -1 
formof }0 -—3 1 0 
0 O 2) 2 
22. Find the (i) nullspace, (ii) column space, 
form of 3 pone 
0 -2 il il 
23. Find the (i) nullspace, (ii) column space, 
23 -3 O 
formof }0 1 —-1 2 
o I —2 
24. Find the (i) nullspace, (ii) column space, 
—2 4 -3 0 
formof} 1 1 —-1 £5 
5 1 O —5 
25. Find the (i) nullspace, (ii) column space, 
—2 4 0 2 
form of |} 1 t 8 2 
1 —-1 1 0 
26. Find the (i) nullspace, (ii) column space, 
2 6 0 4 
formof |—1 1 4 D 
1 —-1 -4 -2 


and (iii) reduced-row echelon 


and (iii) reduced-row echelon 


and (iii) reduced-row echelon 


and (iii) reduced-row echelon 


and (iii) reduced-row echelon 


and (iii) reduced-row echelon 
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Project 5A: Transition Matrix and Stochastic Pro- 


cesses 
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We now consider a transition matrix in stochastic processes, which 
describes the (transition) probability of one state going to the next. We 
make the assumption that the system going from one state to the next 
only depends on the current state of the system and not on the myriad 
of possibilities for how one could have arrived at the given configuration. 
This is a reasonable assumption and is a key characteristic of Markov 
chains, studied in the theory of probability. If we consider a system with 
3 states, we write 


(ii 2 FOB 
T= | pi2 pee ps2 |, 
P13 P23 P33 


where 
pi; is the probability of moving from state 7 to state j. 


For example, p23 is the probability of the system moving from state 2 to 
state 3. Note that the probability p,; is located in the (T),; position of 
the matrix. If we begin with an initial state vector x9, we can calculate 
the next state as x} = Tx. Similarly, the next state of the system is 
X2 = Tx; = T?xp, and so on. The long-term behavior of the system can 
be described by examining x, = T”xo for large n. 


Application: 

Consider a town of 30,000 families (economic units) who have been 
grouped into three economic brackets: lower, middle, and upper. Each 
year there is a 9% chance that the lower move into the middle, and 12% 
chance that the middle move back to the lower; there is an 8% chance 
that the middle move to the upper, and 10% chance that the upper move 
down to the middle; finally there is a 3% chance that the lower move 
directly to the upper, and 4% chance that the upper move down to the 
lower. These transitions occur continuously throughout the year as peo- 
ple are hired, laid off, fired, promoted, retire, and change careers. 

Assume that initially there are 10,000 lower, 12,000 middle, and 8,000 
upper income families and consider the state diagram for this situation 
shown in Figure 5.2. 

Write the transition matrix of this system. Assuming that n is mea- 
sured in years, find the number of families in each state after 10 years; 
after 20 years; after 50 years. (Remember to use A = VAV~! for effi- 
ciently raising a matrix to a high power.) 

Now find the eigenvalues and eigenvectors of the transition matrix. 
Calculate T°°xo. Give a mathematical explanation for what is happen- 
ing. 
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(State 3) 


FIGURE 5.2: General state diagram for income class model of Project 5A. 


Project 5B: Signal Processing 

In Signal Processing, one is interested in observing and measuring a sys- 
tem with intent of applying a control that will make the system go to 
a known state. If x is the true state of the system and y the observed 
state, then the basic linear equations that one tries to analyze can be 
written 


Aa 
y = Bx+ Cu, (5.145) 


where A, F,B,C are n x n matrices and u,x,y are n-dimensional vec- 
tors. We are interested in seeing how this linear system responds to an 
exponential input. This project investigates solutions of (5.145). 

(1) Suppose the input signal is of the form u = e** for diagonal matrix 
S with s,j € (A) for any j =1,...,n, where \(A) are the eigenvalues 
of A. Show that 


t 
x(t) = e®*x(0) + a) eo) Bar 
0 


(2) Show that this can be simplified to give 
x(t) = e“! (x(0) — (S — A)“'F) + (S— A) 'Fe* 
and conclude that the observed state of (5.145) can be written 
y(t) = Be** (x(0) - (S — A)""F) + (C+ B(S— Ay) &®. 


Now let’s solve this system again but assuming a general input u. 
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Chapter 6 


Geometric Approaches and 
Applications of Systems of 
Differential Equations 


In this chapter, we examine systems of the form 


dx 


a f(t,x, p), (6.1) 


where x € R", f is an n-dimensional function (possibly nonlinear), p € R™ 
is a vector of parameters, and ¢ is the independent variable. We have seen a 
system like this before with n = 1; in Sections 2.3-2.4, we considered 


xv’ =ra(a—x)(x —b), 


which is in the form of (6.1) withn =1, p=[r a }]? so that m= 3. 


6.1 An Introduction to the Phase Plane 


This section considers an example where both analytical and graphical 
methods provide useful insight into the behavior of solutions. Some of the 
topics in linear algebra found in Sections 5.4 and Appendix B are particularly 
helpful. 

To begin our study, we will consider systems of two linear homogeneous 
first-order differential equations. These systems are easily solved by hand with 
the methods of the previous chapter, and the behaviors of their solutions are 
readily categorized. However, they also lend themselves to a useful graphical 
interpretation. We begin by considering systems of the form 


x’ = ax + by 
y =cx+dy (6.2) 


where a, b, c, and d are constants and x = x(t), y = y(t). 


Vector Fields and the Phase Plane 


To motivate our study of such a system, we consider an undamped mass-spring 
system, also known as a simple harmonic oscillator, which we studied 
previously in Section 3.7: 

ma" +ka = 0. 
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Using the methods of Section 3.4, we solve for the highest-order derivative to 
obtain 
—k 

LG =—x2. 
Making the substitution y = a’ so that y’ = x” allows us to write the system 
in terms of the variables x, y: 


v=y 
—k 
y = —« 
m 


(6.3) 


This is an example of a second-order system (6.2) with a = d = 0, b = 1, 
c = —k/m. At this point, we will not use numerical methods to analyze 
the behavior of solutions. Indeed, we could easily have solved this system 
because it is homogeneous with constant coefficients. Instead, we will use a 
graphical approach, analogous to phase line analysis of first-order autonomous 
equations. We view solutions in the phase plane, that is, the z-y plane where 
x and y are the two variables in this system. The right-hand sides of (6.3), 
and more generally (6.2), tell us how the system is changing at the given 
point and the change is given by (2’,y’). Thus, to each point (x,y) in the 
phase plane, we will associate a vector (x’, y’) that describes the change. The 
collection of these vectors makes up what we call the vector field. Once we 
specify an initial condition, our motion is determined for all t. 

For the equation of the simple harmonic oscillator, we can easily calculate 
slope lines according to the quadrant, keeping in mind that m and k are always 
positive. We refer the reader to Figure 6.1 as we go from quadrants 4 down 
to quadrant 1: 


Quadrant in Phase Plane 
4th 3rd 2nd Ist 


t 


FIGURE 6.1: Simple harmonic oscillator and the phase plane. 


4th quadrant: x > 0, y < 0. Thus, (6.3) gives 2’ < 0 and y’ < 0 and 
the solution in the phase plane is moving to the left (because x’ < 0) 
and down (because y’ < 0). In terms of the physical picture, the spring 
length is extended past its rest length but is beginning to compress as 
the block moves up. 
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AA A = 7 —e pp 8 a a a A A A 7 2 2 pe a 
A A A A 7 ee A A A A 77 e 
AAA AAS 
JA AAA Byer 
PA AAA Ae SS \ 


PP AAAAPma ss \ 
frrrhrAzrerrxnrvyvyNN4 
phe dae Teepe 
RRL R RR] 
VN N odd 
WAN cars 


KKK pe we oo 
RRR Rew ee we SS 
KK ROR RE pe er a 

ROKR RRR SR ee ROK ROK BS SER Se eo 
KKK WHR He ee ee we WKH Hee ee we ew 


(a) (b) 
FIGURE 6.2: Simple harmonic oscillator with m = 2, k = 3: (a) Vec- 


tor field; (b) vector field with orbits corresponding to the initial conditions 
(—1,0), (0,2), and (3,1). 


3rd quadrant: x < 0, y < 0. We have that x’ < 0 and y’ > 0 and the 
solution is moving to the left (because x’ < 0) and up (because y’ > 0). 
In terms of the physical picture, the spring length is shorter than its 
rest length and is continuing to compress as the block moves up. 


2nd quadrant: x < 0, y > 0. We have that x’ > 0 and y’ > 0 and the 
solution is moving to the right (because x’ > 0) and up (because y’ > 0). 
In terms of the physical picture, the spring length is shorter than its rest 
length but is beginning to extend as the block moves down. 


1st quadrant: x > 0, y > 0. We can substitute values to see that x’ > 0 
and y’ < 0 and the solution is moving to the right (because x’ > 0 
and thus x is increasing) and down (because y’ < 0). In terms of the 
physical picture, the spring length is extended past its rest length and 
is continuing to extend as the block moves down. 


The vector field for the simple harmonic oscillator with m = 2,k = 3 is given 
in Figure 6.2(a). Equally useful is the inclusion of solutions in this picture. We 
will often refer to the solutions as trajectories. We should be careful here, 
though, because we are technically not looking at solutions since solutions live 
in the three-dimensional t-x-y space. What we are viewing are the orbits of 
this equation. As long as t does not explicitly appear in our equations, i-e., 
the system is autonomous (constant coefficient and homogeneous for linear 
equations), it is usually safe to think of the curves we draw as solutions. As 
we mentioned, given any initial condition, we can begin to trace out its path 
because we know that the vector field is tangent to the orbit at each point in 
the phase plane. Figure 6.2(b) shows two orbits of this system. 

The phase plane with the orbits for various initial conditions drawn in is 
called the phase portrait of the system. Note that even if we do not super- 
impose the vector field, we still refer to it as the phase portrait. The reader 
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should compare Figures 6.1 and 6.2 until convinced that they are describing 
the same situation. Remember that the horizontal axis represents the position 
and the vertical axis represents the velocity of the mass. 

Every single point in the phase plane describes a part of a given orbit of our 
system. Although the origin may look boring (the zero vector!), we actually 
give it a special name: equilibrium point. This word has the same con- 
text as it did when we discussed autonomous first-order equations. It simply 
means a point where there is no change in the x or y value of the system, that 
is, x(t) = 0 and y'(t) = 0. We note that for any constant coefficient, homo- 
geneous, first-order system of the form given in Equation (5.1), the origin is 
always an equilibrium point. 


Classification of Equilibrium Solutions 


Eigenvalues and eigenvectors first arose in our discussion as the number \ and 
vector v that allowed e**v to be a solution of the vector form of 6.2, x’ = Ax 


with A = b “| . We calculated the characteristic equation: 
0 = det(A — a1) = aet |° >? Pay = (a — »)(d—A) — bd 
= 2 — (a +d) + (ad — bc). (6.4) 


We set 6 = a+d and observe that this is the trace of the coefficient matrix and 
similarly for y = ad— bc as the determinant. The roots of the characteristic 
equation \? — 8 + 7¥ are easily seen to be 


a 2_4 
yg = EVR, (69 
We can then write the general solution as 


» 


x= cettvy + ce?! vo 


as we did in Section 5.5. (Repeated eigenvalues that require Section 5.6 will 
be discussed shortly.) Our interest here is in understanding the qualitative 
behavior of the solution, especially as t + oo. 


| Example 1 Consider , 


x = —d5x + 8y 
y = —4a + Ty. 


We can easily calculate the eigenvalue and eigenvector pairs as 


(fe) = f+ (} 
nfl El 


with general solution 
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a a a a a a a 


FIGURE 6.3: Phase portrait for Example 1. The origin is a saddle. The 
stable direction is along the [2 1]? eigenvector and the unstable direction is 
along the [1 1]” eigenvector. 


The first pair says that along the vector [2 1]", which lies along the line 
y = x/2, the solution is decreasing because 4; = —1 < 0. The second pair 
says that along the vector [1 1], which lies along the line y = 2, the solu- 
tion is increasing because Ay = 3 > 0. Our computer programs can generate 
the phase portrait, including the eigenvectors. Solutions are attracted to the 
origin along the first eigenvector (the stable direction) but are repelled from 
the origin along the second eigenvector (the unstable direction). Note that 
the Existence and Uniqueness theorem (Theorem 5.1.1) tells us that solu- 
tions do not cross each other. Because the system has constant coefficients, 
this means that trajectories cannot cross either. We can make an interesting 
mathematical observation: As t —> oo, all solutions approach the line y = x; 
as t —+ —oo, all solutions approach the line y = 7/2. This type of behavior 
is termed a saddle point; see Figure 6.3. 


A 
| Example 2| Consider the system: 
x’ = —32 + 4y 
y = —4x — 3y. 


We can calculate, either by hand or on the computer, that the eigenvalues are 
complex and are Ay,2 = —3 + 42. We can write the real-valued solution as 


“| _3t sin 4t cos 4t 
H 7 fa oe + ¢2 cee ‘ 


We know solutions rotate because of the complex eigenvalues and decay as 
t — oo because of the e~*'. If we consider [1 0]”, we can observe that it is 
rotated clockwise (via left multiplication by A, since [x’ y']" =[-3 —3]"). 
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Thus solutions spiral clockwise into the origin and we say the origin is a 
stable spiral; see Figure 6.4. See Appendix B.3 for an additional discussion 
and interpretation via linear transformations. 


FIGURE 6.4: Phase portrait for Example 2. The origin is a stable spiral. 
Note how each vector is rotated clockwise, as seen by left multiplication by 


A. 
ie] 


System (6.2) has equilibrium points whenever there is no change in either 
variable, i.e., whenever both derivatives are zero. As long as the system is 
non-degenerate, the only equilibrium is the origin (0,0). If all the trajectories 
move toward an equilibrium point, it is said to be stable and is sometimes 
called a sink; if they all move away, it is said to be unstable and is sometimes 
called a source; if some trajectories move toward and others move away, it 
is called a saddle; and if all trajectories orbit around the equilibrium point, 
it is called a center. Further, the stable and unstable equilibria may exhibit 
spiraling behaviors in which case they are called stable spirals or unstable 
spirals (also called spiral sinks and spiral sources, respectively). Some- 
times we will use the word node (e.g., stable node/nodal sink or unstable 
node/nodal source) to indicate that no spiraling is occurring. These results 
are summarized in the following theorem. 


THEOREM 6.1.1 

Consider (6.2). Let 6 =a-+d and y = ad — bc; then 

a. If y < 0, then the origin is a saddle. 

b. If y > 0 and £ < 0, then the origin is stable. 

c. If y > 0 and 6 > 0, then the origin is unstable. 

d. If y > 0 and 6 = 0, then the origin is a center. 

e. If 6? — 4y < 0, then a sink or source is a stable spiral or an unstable 
spiral, respectively. 


Figures 6.5 and 6.6 summarize these behaviors, based on the values of £ 
and y. We note that the straight lines in the case of the nodes and saddle are 
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given by the eigenvectors. Also, the borderline cases can be considered 
as well: 

(i) B? —4y = 0 corresponds to a repeated eigenvalue; if two eigenvectors exist, 
it is called a star whereas if only one eigenvector exists, then the general 
solution is given by the methods of Section 5.6 and the origin is called a 
degenerate node; 

(ii) y = 0 corresponds to at least one zero eigenvalue and the origin is either 
contained in a line of equilibria (one zero eigenvalue) or a plane of eigenvalues 
(if A = 0); these are called non-isolated equilibrium points. 


saddle 


FIGURE 6.5: Classification of equilibria in the 6-y plane; see Theorem 
6.1.1. 


unstable spirals unstable node x 


FIGURE 6.6: Sample phase portraits from Figure 6.5. The coordinate 
axes are given in the lower right corner of this figure. 
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Often our primary interest is in the behavior of solutions, rather than the 
solutions themselves. From the above discussion, notice that by looking at 
the system of equations and evaluating 6 and ¥, we are able to predict the 
behavior of the system. 


| Example 3 | Consider the system 


wv =2Qe+y 
y = —3x + 4y. 


Here 6 = 6 and y= 8+ 3 = 11, so §? — 4y = 36 — 44 = —8. The origin is 
the only equilibrium point. From Figure 6.5 we note that since 8 and y are 
both positive, we have either an unstable node or an unstable spiral. Since 
B? —4y < 0, the trajectories spiral away from the equilibrium and we see that 
we have an unstable spiral. If we mutliply A with [1 0]7, we see that the 
rotation is clockwise. 


@ 
| Example 4 | Consider the simple harmonic oscillator from before: 
g = 
—k 
i= —z, 6.6 
== (6.6) 


Here 8 = 0 and y=k/m > 0. The origin is the only equilibrium point and 
it’s a center with trajectories encircling it in closed curves. The direction of 


rotation is again clockwise. = 


Three or More Equations 


In the case of a 2 x 2 system, it is easy to use Theorem 6.1.1 to characterize 
the stability of the equilibria (the origin). For a general system of n first-order 
equations, we can again speak of equilibria of the system and we again have 
the types mentioned in Theorem 6.1.1. Except in very special cases, the origin 
will again be the only equilibrium solution that we need to consider. In the 
two-dimensional case, we talked about viewing the trajectories in the phase 
plane. For a system of n equations, the trajectories now live in n dimensional 
phase space and we can only see (at most) three dimensions at a time. We 
can, however, characterize the stability according to the eigenvalues of the 
matrix. It is important to note that the following theorem also holds for a 
2 x 2 system and can easily be derived from Theorem 6.1.1 by writing the 
eigenvalues in terms of the trace and determinant. 
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THEOREM 6.1.2 

Let {Ai, A2,-+: ,An} be the n (real or complex [non-real], possibly re- 
peated) eigenvalues of the coefficient matrix A of a given linear constant- 
coefficient homogeneous system. 

a. If the real part of the eigenvalue Re(\;) < 0 for all 7, then the equi- 
librium point is stable. 

b. If the real part of the eigenvalue Re(A;) < 0 for at least one i and 
the real part of the eigenvalue Re(A;) > 0 for at least one j, then the 
equilibrium point is a saddle. 

c. If the real part of the eigenvalue Re(A;) > 0 for all i, then the equi- 
librium point is unstable. 

d. If any of the eigenvalues are complex (non-real), then the stable or 
unstable equilibria is a spiral; if all of the eigenvalues are real, it is a 
node; 

e. If a pair of complex conjugate eigenvalues A;, A; satisfy Re(A\;) = 0, 
then the equilibrium is a center in the plane containing the corresponding 
eigenvectors. 


As with two dimensions, we refer to equilibrium solutions as stable spirals 
(or spiral sinks), stable nodes (or nodal sinks), unstable spirals (or spiral 
sources), unstable nodes (or nodal sources), and saddles. 

This theorem also applies to a system of two equations and it was straight- 
forward to view the phase portraits in the phase plane. In higher dimensions, 
we can have combinations of the different behaviors. For example, we may 
have an unstable spiral in one plane even though solutions may be attracted 
to this plane! Sketching phase portraits becomes much more difficult although 
the pictures from Figure 6.6 are still the generic ones that may result. 


| Example 5:| Consider the following system: 


GS 22 = y= 22 
y = —4x — 5y + 2z 
z= -02 -—y+zZ. 


Calculate the eigenvalues and use Theorem 6.1.2 to determine the stability of 
the equilibrium point (the origin). 


Solution 
We can calculate the eigenvalues either by hand or with the computer. Doing 
so gives 

Ay = 3, Ag = —6, Az = —3. 


Part (b) of Theorem 6.1.2 shows that the origin is a saddle. 
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Problems 

In Problems 1-15, (i) use Theorem 6.1.1 to determine the stability of the 
origin (it’s the only equilibrium solution) for the given systems of equations; 
(ii) use a computer algebra system to draw the vector field; (iii) either by 
hand or with the computer, sketch some orbits to verify your conclusion in 


1 x’ = —32 + by 9 v=x-y 3 wv =x+2y 
"| yf = 2x + 5y "| y! = 3a —4y "| y! =a + 4y 
P| x! = 2x — 2y a =—3r+y of my 
y’ = 5a —2y “ly! =2Qe+y y = 3xr+2y 
7 vw =4a+y xv’ = —2y xv’ =ax—8y 
y’ = 3a + 2y "| yf = 4a + 5y y =x2+3y 
x’ = 3a — 5y a’ = —a — By a’ = —3a — By 
10 ee Ty ev iaair a y’ =x —6by 
x’ = 5a — by av = 5a x’ = Tx + by 
i =m M2 oie a ae 


16. Consider the simple harmonic oscillator with damping: 7” + ba’ +ka = 0, 
where b,k > 0. Convert this to a system of 2 first-order equations and then 
answer questions (i)—(iii) above. 

17. Use Theorem 6.1.1 to find values for b and d so that the equilibrium 
vw’ =a+by 
y =a+dy 
(a) unstable node, (b) stable node, (c) unstable spiral, 
(d) stable spiral, (e) saddle point, (f) center. 


solution (the origin) of { is an 


18. We previously showed that we can reduce a second-order equation to a 
system of 2 first-order equations and thus analyze with methods of this 
section. Consider (6.2) and follow the steps here to show how Section 3.6 
can also give us Theorem 6.1.1. 

i) Differentiate x’ = ax + by to obtain x” and substitute y’ = cx + dy 

into this equation. 

ii) Then substitute by = x’ — ax into this, collect like terms, and rear- 

range to obtain 7” — (a+ d)a' + (ad — bc)x = 0. 

iii) Observe that 6 = a+d is the trace of the coefficient matrix, and 

y = ad — bc is the determinant. 

iv) Show the characteristic equation of the second-order differential equa- 

tion is \? — 8\ + y = 0 and use the quadratic formula to verify the con- 

clusions of Theorem 6.1.1 in terms of eigenvalues. (Note: we used 11,12 

in Chapter 4.) 


x’ = —5x + 8y 


19. Use Problem 18 to rewrite { °, as a second-order equation. 
y = —4xa + Ty. 
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Then use the Section 3.6 to find the general solution. 


For Problems 20-27, use Theorem 6.1.2 to classify the stability of the origin 
(the only equilibrium solution). 


uv’ = —8x — By — 2z x’ = —13a + 4y — 8z 
20. < y’ = —13a4 14y— z 21.4 y =8r+y4+4z 
zg! = 124 — 1l5y — 6z z’ = 42x —-b6y4 21z 
wv’ =1lxe —6y+10z vw! = 2a —Qy+z 
22.¢ y =—5a+4y—5z 23. ¢ y! = —3a + 3y+2 
2! = —13x + 9y — 12z 2! = 3a — 2y 
ve =—-x+2z wv =x—2y+2z 
24.6 y' =—3y+2z 25.4 y! = —4x + 3y + 2z 
go = -y-2z zg =Ar—Qy-z 
-1 -1 1 1 -5 -1 
26.x’=] 1 —-1 O|x 27.x/=]1 3 1 |x 
0 0 ol 0 O 1 


6.2 Nonlinear Equations and Phase Plane Analysis 


Up to this point, we have studied a system of first-order linear differential 
equations with constant coefficients. We will now consider the more general 
situation where the equations are first-order but are nonlinear. There are 
numerous books devoted to the study of such equations and we are merely 
“scratching the surface” of this topic. For an extremely accessible yet thor- 
ough excursion into nonlinear dynamics, the interested reader should examine 
the book by Strogatz given in the references [48]. 

Let’s consider the following two differential equations: 


a! = f(t, x,y) 
y' = g(t, 2,4). (6.7) 
When f and g are nonlinear functions, it will be rare when we can actu- 
ally find an exact solution to these equations. In such cases we must resort 
to graphical or numerical analysis and interpretation of the behavior of the 


solutions. To better understand this new approach, we will consider an au- 
tonomous nonlinear system of the form 


a = re y) 
y' = g(2,y), (6.8) 


where time, t, is not explicit. We begin with an existence and uniqueness 
theorem for a general system. 
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THEOREM 6.2.1 

Consider the system given in (6.7) with initial condition «x(to) = 
xo, y(to) = yo. If Of /Ox, Of /Oy, Og/Ox, Og/Oy are all continuous on 
some rectangular region R = {(a,y)|a < « <b, c< y < d} containing 
the point (to, 20, yo), then there exists a unique solution to (6.7) defined 
on (t9 — T,to9 + 7) for some 7 > 0. 


We shall assume that all partial derivatives are continuous for the remain- 
der of this section. 


Equilibria 

Just as with linear systems in Section 6.1, we are interested in finding the 
equilibria! of the system (6.8) of first-order differential equations. We know 
that the solution (a,y) is at equilibrium when it is not changing, i.e., when 
xv’ = 0 and y’ = 0. In order to find equilibria, we need to consider the 
curves f(x,y) = 0 and g(x,y) = 0 in the phase plane. Any curve of the form 
h(x,y) = k, where k is a constant, is called an isocline or level curve of the 
function h. In other words, a curve is an isocline or level curve of a function if 
the function takes the same value at every point on the curve. In the special 
case when k = 0, the curve h(z,y) = k = 0 is called a nullcline. In the 
system (6.8), f(a, y) = 0 and g(x,y) = 0 are the nullclines since they take the 
value zero. From the discussion above we see that the intersection point of 
the two nullclines is an equilibrium. More formally (a*, y*) is an equilibrium 
of (6.8) if f(a*,y*) =0 and g(a*,y*) = 0. 


| Example 1:| Consider 


/ 
a’ =y—2? 


y =yr-Z. (6.9) 
Here, f(x,y) = y—2? and g(x,y) = y—2. Therefore the nullclines are y = x? 
and y = x. These curves intersect at two points (0,0) and (1,1). From the 
definition we can conclude that these are the equilibrium solutions (2*, y*). 


Directions of flow 


We also interpreted the solutions and trajectories geometrically in the phase 
plane for our linear system. When the equations are nonlinear, we still con- 
sider the phase plane but now allow for the possibility of multiple equilibria. 
The vector field in the phase plane helps us to picture the behavior of the 


1Recall that equilibria are also referred to as constant solutions, critical points, fixed points, 
and steady-state solutions. 
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FIGURE 6.7: Nullclines of system (6.9). 


solutions. One may think of the vector field as a flowing body of water. If we 
drop a stick in the water, it moves in a path determined by the flow vectors. 
A computer-generated vector field gives a more accurate sense of the flow of 
trajectories; it’s easier to observe, e.g., that as a trajectory crosses a nullcline, 
the direction it moves changes; see Figure 6.8(a). Figure 6.8(b) shows the 
nullclines and vector field superimposed to illustrate horizontal and vertical 
flow along each nullcline. In practice, we will not superimpose nullclines and 
vector fields because only trajectories are plotted on vector fields and having 
nullclines over these would be very confusing. 


thf AAAAAA A fA ina t ZA 4 
RRP A AAAAA A fp X32 f AA A 
PP AAAAAAA fw i As va 
PRA AAAAA AR Oe  \ JA el 
\ fof Aut AAA A A aes e Ae Aus Pad 
NA PRA AAA Ae wee a AA “~?Z 
NNT PR AAA wr ae \ f7 gy 
NNN AP Ate oe oe rrr ~ NY LY 
WLNOR ON Sof oD er ager eS Noe oe 
si LL I a ~ Se LL OK oo a 
ss i KL ~ CO LO 
wes se ig SL LL — <r ar ar a i ie i ee 
i we +3 ar fr ar i a a ee 
Pe ee er < aye ee tee ee are 


FIGURE 6.8: (a) Vector field of system (6.9). ). (b) Nullclines superimposed 
on vector field to show the horizontal or vertical flow along each nullcline. 
In practice we will not superimpose the nullclines because we will only plot 
trajectories (solutions) on the vector field; see Figure 6.9. 


From a phase plane drawing, saddle points are evident; see Figure 6.9. How- 
ever, it is difficult to tell if the equilbrium is a spiral sink, a center, or a spiral 
source. We discuss two methods used to classify our equilibrium points. The 
first is to use a differential-equations solver to find either exact or approxi- 
mate solutions for initial points in various locations (i.e., for different initial 
conditions) and observe the behavior these solutions exhibit. For a review of 
the behavior near equilibrium points, see Figure 6.6. The second method is 
to do a local analysis of the solutions around the equilibrium point to classify 
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the stability of the equilibrium. Such an approach requires us to linearize our 
equation or system and consider the behavior of the linearized system. The 
topology of the linearized system will be the same as the original system as 
long as the eigenvalues of the linearized system do not have zero real part. 


ttf AAA A ZAZA fy ~~ 
a A 
Ve 
ye 
1 oF 
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FIGURE 6.9: Phase portrait: trajectories superimposed onto vector field 
of system (6.9). 


Linearization 
Linearization of a differential equation is the replacement of the equation of 
a curve or surface by the appropriate tangent line or tangent plane centered 
at a point. From calculus, we know that a differentiable function F(x) can be 
approximated near a point by its tangent line, F(a) + F(a)+F"’(a)(#—a). In 
calculus of several variables, this is extended to a plane tangent to a surface 
at a point (x,y). The surface h(x,y) is approximated by the linear Taylor 
expansion: 
h 
hxyy) = Ala", y") + S(0* yea 2°) + Se" Vy — 9) 

This is usually done to study the behavior of a system near that point, in 
our case the equilibrium point. Linearization of a set of equations yields a 
system of linear differential equations. Therefore, we use the methods learned 
in Section 6.1 to analyze and determine the behavior of solutions close to the 
point of interest. 

Even though linearization can be done at any point, we linearize only around 
equilibria. Let (x*,y*) be equilibria of the system (6.8), 


dx 

ae = f(x,y) 
dy _ 

dt —_ g(x,y), 


and let (x*,y*) = 0 be an equilibrium, ie., f(2*,y*) = 0 and g(a*,y*) = 0. 
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We use the notation f(a, b) to denote the partial derivative of f with respect 
to x evaluated at (a,b), and f,(a,6) is the partial of f with respect to y. 
Similar notation is used for the function g. 

The functions f and g at (a*,y*) are approximated by Taylor expanding 
f(x,y) about (a*,y*) and omitting any higher-order terms: 


dt = f(x,y) 
a f(x", y") + folx*,y*)(@ — 2") + fy(z",y")(y—y") 
dy 
dt = g(x,y) 
me g(x*,y") + ga(a*,y*)(a — 2") + gy(z*,y*)(y — yy"). 
) 


= 0 and g(a*,y*) =0. Also 
= cS — cS d 
d(iz—a*) dz ad d(y — y*) dy 


dt — dt dt dt 
so we have the following pair of equations: 
d(x — x* a gate * Ok * 
MeO) we folat a (e— 2") + hula" vy —9") 
d(y — y") 


= gu (x", y")(x — 2") + gy(z", y")(y — y")- 


It is simpler to change coordinate systems and translate the equilibrium to 
the origin. Let u = a —2* andv=y-—vy*. Then we have 

du . x 

Sw fol y)ut fyle"y"v 


dv * * * * 
aa Gu (x,y )u + gy(x*, y")v. (6.10) 


This is a linear system which we rewrite as 


ele, 


The matrix of partial derivatives is sometimes called the Jacobian matrix, 
and we use the notation 


_ f(x,y) fy(a,y) 
jea= |e" oak = 


This matrix evaluated at the equilibirum, J(*, y*), is then used with Theorem 
6.1.1 to determine the nature of the solution. 

This linearization process may seem involved, but much of the complication 
is in the development of the equations. In practice it is only necessary to 
compute the four partial derivatives at the equilibrium and then use Theorem 
6.1.1 (or equivalently, Theorem 6.1.2) to determine the nature of the solution. 
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| Example 2:| Consider the system (6.9) from Example 1: 


dx 2 
7 
dy 

a7 


Find the equilibria and determine their stability via linearization. 


Solution 
We need to solve the right-hand sides of the equations simultaneously. Solving 
the second equation gives y = x. We then substitute into the the first equation 
to get 

g—-2?=0=—>2=0,1. 


Thus we have two equilibria, (0,0) and (1,1). Calculating their stability via 
linearization requires use of the Jacobian. We can easily calculate it as 


—2x2 1 
= [% 3). 
Evaluating the Jacobian at the respective equilibria gives 
—27 1 0 1 
roo-[ f,,-[4 J} 
-1 1 (0,0) -1 1 
so 8 = Tr(J(0,0)) = 1 and y = det(J(0,0)) = 1; thus (0,0) is a spiral source. 


We also have 
—2 1 
sary [2 3] 


so 6 = Tr(J(1,1)) = —1 and y = det(J(1,1)) = —1; thus (1,1) is a saddle 


oint. See Figure 6.9. 
p g = 


6.2.1 Systems of More Than Two Equations 


Nonlinear systems of equations are an active area of research as these equa- 
tions occur in many areas of the sciences. 


x = Fit, Bij Bd, 22 4 By) 
x = fol b€i59 54.25 br) 
i, = Fah Tigi ns a J (6.12) 


It will be extremely rare when we can actually find a closed form solution to 
these equations. As with two equations, we must then rely heavily on graph- 
ical, approximation, or numerical techniques. The existence and uniqueness 
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theorem for this general system is analogous to the one for two equations—we 
need to check that each of the functions f; and partial derivatives Of; /Ozx; 
are continuous in order to guarantee existence and uniqueness. We will of- 
ten be concerned with these equations when they are autonomous, that is, 
there is not explicit ¢ in the problem. The following theorem gives the linear 
stability in a neighborhood of an equilibrium solution. If a system has mul- 
tiple equilibrium solutions, the theorem may be applied to each equilibrium 
solution. We often write (6.12) in its vector notation for convenience: 


THEOREM 6.2.2 

Let x’ = f(x) be a nonlinear system of n first-order equations with x* as 
an equilibrium solution and f a sufficiently smooth vector function. Let 
J be the Jacobian (the matrix of partial derivatives) evaluated at this 
equilibrium solution: 


Of, /Ox1 Of: /Ox2 cos Of, /Oxn 
Of2/Ox1 Of2/Ox2 con Of2/Oxn, 

ac) = ; . (6.13) 
Ofn/O01 Ofn/At2 +++ Ofn/O%r| 


Let {A1, A2,°-: ; An} be the n (real or complex, possibly repeated) eigen- 
values of the Jacobian matrix. 

a. If the real part of the eigenvalue Re(\;) < 0 for all 7, then the equi- 
librium is stable. 

b. If the real part of the eigenvalue Re(A;) < 0 for at least one 7 and 
Re(A;) > 0 for at least one 7, then the equilibrium is a saddle. 

c. If the real part of the eigenvalue Re(A;) > 0 for all i, then the equi- 
librium is unstable. 

d. If any of the eigenvalues are complex, then the stable or unstable 
equilibria is a spiral; if all of the eigenvalues are real, it is a node. 

e. If a pair of complex conjugate eigenvalues \;, \; satisfy Re(A;) = 
0, then the equilibrium is a linear center in the plane containing the 
corresponding eigenvectors. 


THEOREM 6.2.3 

Let x’ = f(x) be a nonlinear system of n first-order equations with x* 
as an equilibrium solution and f a sufficiently smooth vector function. 
If Re(A;) 4 0 for all 7, then the predictions given by the linear stability 
results of Theorem 6.2.2 hold for the equilibrium solution in the nonlinear 
system. 
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The significance of Theorem 6.2.3 cannot be understated. We found an 
equilibrium solution x* and linearized about it. That is, we considered only 
the linear terms near this equilibrium solution. The results of the theorem 
allow us to conclude that only looking at linear terms near the equilibrium 
solution is sufficient to give us accurate stability predictions, as long as the real 
part of all eigenvalues is nonzero. This should be believable because adding 
nonlinear terms could possibly change the stability in these borderline cases. 
Alternative techniques beyond the scope of this book are needed to address 
these situations. 

Thus the techniques used for autonomous systems are very familiar: finding 
equilibrium solutions, linearizing the system about the equilibria, determin- 
ing the linear stability of the equilibria, and constructing phase portraits with 
the help of a computer program. Indeed, our plan of attack in order to 
understand the behavior of the solutions was identical for a system of two 
equations. The main difference here has to do with the structure of the space 
in which trajectories live. Things were very nice in two dimensions in that we 
could characterize many things about equilibria. Once we introduce a third 
(or more) dimension(s), very strange things can happen. The mathematical 
subject of chaos arose because of the kind of this strange behavior that can 
occur. We refer the interested reader to other books for an introduction. 


| Example 3:| Find equilibrium solutions for the system 


x’ = —6x + 6y 

y = 362 —y — xz 

z = —3z4+2y. (6.14) 
Then use Theorems 6.2.2 and 6.2.3 to classify the stability of the equilibrium 
solutions. 


Solution 
We use our three computer software packages to help us with these and give 
the code at the end of the example. We find three equilibria in the system: 


(x*, y*, 2*) = (0,0,0), (v/105, V'105, 35) (—v105, -v'105, 35) 
In order to determine the stability of the equilibria, we first need to calculate 


the Jacobian matrix of the system: 


—6 6 0 
J=|]36-—z2 -1 -z]|, (6.15) 
Yy Hy —3 
and then substitute in the respective equilibrium points. We have 
—7+ V889 


(0,0, 0) : AL = —3, A2,3 = 
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which shows that the origin is a saddle point. According to Theorem 6.2.3, 
we can conclude that the origin is also a saddle in the original system (since 
Re(A;) 4 0). For the second equilibrium, we have 


(V105, V105,35): Ay = —10, A2,3 = +i38V14. 


According to Theorem 6.2.2, this second equilibrium solution is a linear center 
in two directions and stable in the third direction.? According to Theorem 
6.2.3, we can only conclude that we have a linear center—it is possible that we 
have a nonlinear center in the full nonlinear system but it is also possible that 
the inclusion of the nonlinear terms makes this equilibrium solution either a 
stable spiral or an unstable spiral. For the third equilibrium, we have 


(—V105, —-V105,35): Ay =—10, A2,3 = +i3V14. 


This again gives the prediction of a linear center in two directions and stable 
in the third direction and doesn’t allow us to conclude anything about the 
full system. 


The system of the previous example is actually a very well-known system 
that has been studied extensively due to the seemingly unpredictable behay- 
ior of solutions with close initial conditions. Depending on the coefficients of 
the original equations, we can have between one and three equilibria and we 
have the possibility of trajectories wandering endlessly without approaching 
an equilibrium solution. See Problem 15 for another look at this system. 


Problems 

For Problems 1-9, (i) find the equilibria of the given system; (ii) use lin- 
earization and Theorem 6.2.2 to classify the stability of the equilibria; (iii) 
use MATLAB, Maple, or Mathematica to draw the vector field of the system; 
(iv) sketch trajectories on the vector field for various initial conditions (either 
by hand or with the computer). You should verify that your answers from 
parts (iii) and (iv) agree with your predictions in parts (i) and (ii). 


wv =y wv =y-1 ve =y-2 
oe * Vy =a?-y SY yf =a? + 2y 
g=y—«& = a 
4. 5. 6. 
ee y=n—s y=y~-q 
7 eee 8 Co ae ee 
‘ly =a-y "yl = 2° — by Ly =y(2-y) - ay 


?Locally, the plane is defined by the two eigenvectors of the linear center and the third 
direction is determined by the additional eigenvectors. More generally, we can define a 
stable subspace, unstable subspace, and center subspace that divide the space. 
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A well-known equation is the van der Pol oscillator, which models a triode 
valve where the resistance depended on the applied current [16]: 


x" + ea! (a2? -1) +2 =0, (6.16) 


where x = a(t) and e > 0 is aconstant. Using the methods of Section 3.4, 
convert this equation to a system of two first-order equations. Do part (i) 
and (ii) above for a general «. Then do parts (iii) and (iv) with « = 0.1. 
Repeat steps (iii) and (iv) for « = 10, compare your phase portraits, and 
comment on any differences you see. 
We now reconsider Problem 2 from Section 2.6. In a first physics course, 
students derive the equation of motion for a frictionless simple pendulum 
as 

mo” + gsin@ = 0, (6.17) 


where @ is the angle that the pendulum makes with the vertical. We will 
not assume that 6 is small. For convenience, set m= g. 

(a) Convert (6.17) to a system of two first-order equations. 

(b) Find the equilibria for 0 € [—27, 27] and classify stability. 

(c) Graph the nullclines on the phase plane. 

(d) Use MATLAB, Maple, or Mathematica to sketch the vector field for 
the system of two first-order equations. 

(e) Plot trajectories for various initial conditions and obtain a phase 
portrait similar to Figure 2.27 in Section 2.6. Again interpret the qual- 
itatively different motions of the pendulum, keeping in mind that the 
pendulum is allowed to whirl over the top. 


Now consider the simple pendulum with damping: 
6” + 0.30 +0 =0. 


Repeat parts (a)—(d) in the previous problem. Then plot trajectories 
for various initial conditions and compare with the phase portrait of the 
undamped motion. Interpret your picture and the differences between 
the two phase portraits. 


We now reconsider Project 4A of Chapter 4. One formulation of the 
forced Duffing equation is 


x" + ba’ + ka + 62° = Fysin(wt), (6.18) 


where x = x(t). When 6 = 0, the equation reduces to that of the forced 
mass on a spring of Section 4.7. Repeat steps 2-5 of this project but 
now also plot the trajectories in the phase plane. Because this system 
is nonautonomous, you will not be able to use pplane. Besides your 
explanations, be sure to address why the apparent crossing of solutions 
in the phase plane is not a violation of the Existence and Uniqueness 
theorem. 
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14. By Taylor expanding about the equilibrium point (a*, y*, z*) and keeping 
only linear terms show that the three-dimensional system 


_ of of of 
4 f(z, Y, z) Ox Oy Oz 
y’ = g(x,y, 2) has Jacobian J= oa Ba oe 
z= Alay, 2) bh oh bh 


Ox Oy Oz (a* ,y*,2") 


15. The Lorenz system can be written in the form 
x’ =-ox+oy 
‘=re—y- xz 

/ 


z= -oz+cxy, (6.19) 


where o,7r,@ are positive parameters. The system arose as a model of 
convective rolls in the atmosphere. Lorenz studied the parameter values 
o = 10,¢ = 8/3 and examined how the behavior of solutions changed as 
r increased. 

(a) Determine the equilibria and their stability for r = 0.5. 

(b) Determine the equilibria and their stability for r = 2. 

(c) Determine the equilibria and their stability for r =25. 

(d) Plot trajectories in 2-y-z phase space for parts (a), (b), (c). Go 
from t = 0 to t = 100 for three different initial conditions. 


6.3. Bifurcations 


The system of equations (6.8) with an explicit parameter vector p, 


ac = f(z,y,P) 
yf! = g(@,¥,P), 
can have bifurcations as the parameter p varies, just as we did with first- 
order autonomous equations in Section 2.3. Recall that in 1-D, we said that 
a bifurcation occurs when we have a qualitative change in the number or 
stability of equilibrium solutions. This is true in higher dimensions but we 
may also have the appearance (or disappearance) of periodic solutions as well. 
Recall that Theorem 6.2.2 characterized the stability of an equilibrium so- 
lution according to its eigenvalue. Part (a) specifically required Re(\;) < 0 
for all 7 in order to characterize the solution as stable. If one of A; has its real 
part change from negative to positive, the solution will lose its stability. 
Consider only the eigenvalue(s), A, that is involved in the bifurcation. In 
order for the Re(A) to change sign, we must either have 
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(a) \ = 0 bifurcations can be either saddlenode, transcritical, or pitch- 
fork bifurcations 
(b) \ = +tb bifurcations, where b € R, are known as Hopf bifurcations 


These bifurcations are known as local bifurcations as they involve a 
change in the behavior of the system near an equilibrium point and only 
near this point. We have seen the names of the \ = 0 in 1-D but the \ = +7b 
(pure imaginary) name, Hopf bifurcation, is new to us. Besides having a 
pure imaginary eigenvalue, we will also have the appearance or disappearance 
of an isolated periodic trajectory called a limit cycle. (By isolated, we sim- 
ply mean that we can find an € > 0 such that if we begin within e€ of the limit 
cycle, we will not encounter another closed orbit.) 


A = 0 bifurcations 


We can have saddlenode bifurcations in which a saddle point and a node 
(either stable or unstable) coalesce and disappear as a parameter is varied; 
we can have transcritical bifurcations in which a saddle and a node exchange 
stability as one passes through the other as a parameter is varied; we can have 
subcritical pitchfork bifurcations (involving the birth/death of two unstable 
equilibria) and supercritical pitchfork bifurcations (involving the birth/death 
of two stable equilibria) in which two equilibria are born out of one but with 
different stability than the one from which they were born. These types of 
bifurcations occur when one eigenvalue of the point (i.e., equilibrium solution) 
undergoing the bifurcation is zero. 
We consider the basic form for a supercritical pitchfork bifurcation: 


a’ =re— 2° 


y=-y (6.20) 


where r € R. The equilibria are (x*,y*) = (0,0), (/r, —0), (\/7, 0), where 
the last two equilibria only exist when r > 0. As in the first-order equation, 
we have three cases to consider: r < 0,r = 0, and r > 0. We could check 
the stability analytically using the linearization previously discussed. The 
Jacobian is easily calculated as 


r — 3a? 0 
s=| : Bal 


Evaluating at the equilibrium points gives for r < 0 
r 0 
J(0,0) = E =| : 
Thus 6 = Tr(J(0,0)) =r —1 and y = det(J(0,0)) = —r so (0,0) is a spiral 


source. Because we are in the case when r < 0, we see that  < 0 and 7 > 0 
and thus the origin is stable. 
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For r = 0, we have 
0 O 
30,0) = | ar 


Thus 6 = Tr(J(0,0)) = —1 and y = det(J(0,0)) = 0 and the prediction is 
for a linear center. This is a borderline case and thus the conclusion may be 
affected by the nonlinear terms that were ignored. 

For r > 0, we have three equilibria: 


J(0,0) = k “| and J(+V7,0) = ew al 


Thus 6 = Tr(J(0,0)) =r —1 and y = det(J(0,0)) = —r and because r > 0, 
we know this is a saddle point. The Jacobian is the same for the other 
two equilibria and we have that 6 = Tr(J(+/7,0)) = —2r —1 and y = 
det(J(0,0)) = 2r, which shows that both points are stable equilibrium points. 

Thus, for r < 0 the origin is the only equilibrium solution and it is stable. 
For r > 0, two additional equilibria exist that were born out of the origin 
(when r = 0, they are located at (0,0)) and both are stable, while the origin 
has now changed its stability; see Figure 6.10. 
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FIGURE 6.10: Equations 6.20. (a) Phase plane plot of trajectories for r = 
—0.5; there is only one equilibrium, (0,0), and it is stable. (b) Phase plane plot 
of trajectories for r = 0.5; there are three equilibria, (—/5,0), (0,0),(V5, 0). 
The equilibrium (0,0) is a saddle and (+V5,0) are stable nodes. 


To see this, we calculate the characteristic equation of the Jacobian evalu- 
ated at one of the equilibria (in this example, all three give the same answer): 


det(J(0,0) — AI) = (r — A)(-1- A) = 7 4+-A(L- 1) -r=0. 


We substitute \ = 0 and see that r = 0 is the parameter value for one of the 
above four bifurcations. We could then use linearization near the equilibria 
before and after the bifurcation value to see if there were a qualitative change 
in the number or stability of the equilibria. 
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|Example 1:| Consider the system 


a =ru— x? 


y =-y, (6.21) 


for r € R. Determine the type of A = 0 bifurcation that occurs and classify it 
according to the change in the number or stability of the equilibria. Use the 
computer to corroborate your conclusions. 


Solution 

We calculate the equilibria as (0,0) and (r,0). It seems that there is always 
two equilibria except when r = 0 in which case we will only have (0,0). The 
Jacobian is seen to be 


Kawn=["Q* S)), 


with characteristic polynomial \? + (1 — r+ 2x)\ — r+ 2x = 0. To find the 
A = 0 bifurcations, we set A = 0 in this equation and then plug in each of the 
equilibria 

Equilibrium (0,0) : —-r=0 (6.22) 

Equilibrium (r,0) : —r+2r=0. (6.23) 
Both equations are the same: r = 0. This should not be a surprise given that 
the equilibrium points are the same when r = 0. Thus we expect a A = 0 
bifurcation to occur when r = 0. To determine the type of bifurcation, we 


examine what happens for r-values before and after this value, i.e., for r < 0 
and r > 0. Then 


J(0,0) = k =| (6.24) 


and thus (0,0) is stable for r < 0 and a saddle for r > 0 whereas for 


I(r, 0) = Fe bal ; (6.25) 


which shows that (r,0) is a saddle for r < 0 and stable for r > 0. Similar to 


1-D, we call this a transcritical bifurcation; see Figure 6.11. - 


The other two types of 1-D bifurcations seen in Section 2.3, saddlenode 
bifurcations and subcritical pitchfork bifurcations, are again seen in two or 
more dimensions and occur when A = 0 in the characteristic equation. It is 
often useful to track the location of the equilibrium as a function of one of 
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FIGURE 6.11: (a) Phase plane plot of trajectories for r = —0.5; (0,0) is 
stable and (r,0) is a saddle. (b) Phase plane plot of trajectories for r = 0.5; 
(0,0) is now a saddle and (r,0) is stable. The system thus underwent a 
transcritical bifurcation at r = 0. 


the parameters. For example, if we consider the Equations (6.20) that gave 
us a supercritical pitchfork bifurcation: 


a =rx—2? 


y =-y, 

we found the equilibria to be (0,0) and (+y/r,0). The (0,0) equilibrium is 
stable when r < 0 and is unstable (a saddle) if r > 0. The remaining two 
equilibria do not exist for r < 0 and are stable for r > 0. Because y* = 0 for 
all equilibria, we will plot r vs. x*. This type of picture is called a bifurcation 
diagram and the typical convention is to denote stability with a stable curve 
and instability with a dashed curve as shown in Figure 6.12(a). If we consider 
the Equations (6.21) that gave us a transcritical bifurcation: 


a =rx— 2x? 


y=-y, 
we found the equilibria to be (0,0) and (7,0). The (0,0) equilibrium is stable 
when r < 0 and is unstable (a saddle) if r > 0. In contrast, the (r,0) equilib- 
rium is unstable (a saddle) when r < 0 and is stable when r > 0. We again 
plot r vs. x* and observe the bifurcation diagram in Figure 6.12(b). 


Hopf bifurcation 

The other type of local bifurcation that can now occur to change the stability 
of an equilibrium point is a Hopf bifurcation. These also come in super- 
critical and subcritical flavors. This bifurcation occurs when the real part of 
a complex pair of eigenvalues becomes zero (A = ib, with b 4 0 and b € R) 
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2 
(0,0) stable (0,0) stable 


06 (r,0),-’ unstable 


“Ya) =O 0 - 08 1 18 “tye “us 04 ~-02~~S~ SSC 
FIGURE 6.12: Bifurcation diagrams: the x-location and stability of the 
equilibria as a function of the parameter r. (a) The supercritical pitchfork 
bifurcation of Equations (6.20); (b) The transcritical bifurcation of Equations 


(6.21). 


as a parameter is varied, and either before or after the bifurcation value we 
have the presence of a limit cycle. 


|Example 2 Consider the system 


k=yt+ra (6.26) 
y= —a+ry—a“’y (6.27) 


where r € R. Show that the origin undergoes a supercritical Hopf bifur- 
cation when r = 0. 


Solution 
The origin is clearly an equilibrium point and we determine its stability via 
the Jacobian: 
joe) 2. 2 (6.28) 
re ; 
The characteristic equation is then A? — 2rA + 1+ r? = 0. In order to have a 


Hopf bifurcation, we need \ = +ib with b € R and b 4 0. Substituting this 
condition gives 


—b? +147? —2irb=0. 


In order for this to hold, we equate real and imaginary parts on both sides of 
the equation: 


—P+1+r?=0 real part (6.29) 
—2irb=0 imaginary part. (6.30) 
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The second equation gives r = 0 as one condition (since b 4 0). Substitution 
of this into the first gives b? = 1 and since this satisfies both b € R and b 4 0, 
we conclude that we may have a Hopf bifurcation when r = 0. The additional 
requirement we need is the appearance/disappearance of a limit cycle as r 
passes through 0. We enter this system into one of our computer systems and 
choose a variety of initial conditions for a pair of parameter values close to the 
bifurcation value, say r = +£0.1. In Figure 6.13, we observe that the origin is 
a stable spiral for r = —0.1. In contrast, we see that the origin is an unstable 
spiral for r = 0.1 and there is a limit cycle surrounding the origin. Thus 
our system underwent a Hopf bifurcation when r = 0. The Hopf bifurcation 
is called supercritical because the limit cycle involved is stable; that is, tra- 
jectories starting close to it (whether inside or outside) eventually approach it. 


WW NOS ee 


\ \ 
\ \ 
\ 
\ 


Ee A ee es { fea ee eee 


Sr ee N | Pre n 


eee Ny \ LAPLL LL 


ee ee eee 
ae ee eeaa— 


=> 
a 
we 


FIGURE 6.13: (a) Phase plane plot of trajectories for r = —0.1; (0,0) is 
a stable spiral. (b) Phase plane plot of trajectories for r = 0.1; (0,0) is now 
an unstable spiral and a stable limit cycle is present. 


The limit cycle is an isolated closed trajectory (not a center) and is a 
periodic solution. While we must have a switch in stability of the equilibrium 
point, it is the presence of the limit cycle on only one side of the parameter 
bifurcation value that makes this a Hopf bifurcation and the stability of the 
limit cycle that determines the type of Hopf bifurcation. We can also have 
an unstable limit cycle in which case an initial condition starting close to 
it (whether inside or outside) was repelled by it. If an unstable limit cycle is 
present in a Hopf bifurcation, we say that it is subcritical. In either case, 
the limit cycle increases in amplitude as we move further from the bifurcation 
of the parameter value and will shrink to a radius of zero as we approach 
the bifurcation value. If we do not have a limit cycle that appears on either 
side, we call the situation a degenerate Hopf bifurcation. There are other 
types of global bifurcations that can also create (or destroy) limit cycles but 
that do not exclusively occur in a neighborhood of an equilibrium point. 
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| Example 3 | Consider the system 


£= py (6.31) 
y=—atryta?tayty’ (6.32) 


where p,r € R. Show that the origin undergoes a subcritical Hopf bifur- 
cation when r = 0,p > 0. 


Solution 

The origin is clearly an equilibrium point. We note that (1,0) is also an 
equilibrium point but it is not involved in the Hopf bifurcation so we ignore 
it for now. We determine the stability of (0,0) via the Jacobian: 


_| 90 p 
J(0,0) = Ei | . (6.33) 
The characteristic equation is then A? — rA + p = 0. In order to have a Hopf 
bifurcation, we need A = +ib with b € R and b ¥ 0. Substituting this 
condition gives 


—b? + p—irb=0. 


In order for this to hold, we equate real and imaginary parts on both sides of 
the equation: 


—+p=0 real part (6.34) 
—irb=0 imaginary part. (6.35) 


The second equation gives r = 0 as one condition (since b #0). Substitution 
of this into the first gives b? = p, which will only be satisfied when p > 0 
since we know that b € R and b 4 0. Thus we conclude that we may have 
a Hopf bifurcation when r = 0. The additional requirement we need is the 
appearance/disappearance of a limit cycle as r passes through 0 for p > 0. Up 
to this point, our bifurcations have only involved one parameter. Because our 
conditions now involve two parameters, r and p, we say that we have a two 
parameter family of differential equations. While we can have subcritical 
Hopf bifurcations that only involve one parameter, other bifurcations (that we 
have not yet encountered) may need 2 or more parameters in order to occur. 

We enter this system into one of our computer systems and choose a vari- 
ety of initial conditions for a pair of parameter values close to the bifurcation 
value, say r = +0.04 and p = .2. (There are numerous other choices that 
would work.) In Figure 6.13, we observe that the origin is a stable spiral for 
r = —0.04 and is an unstable spiral for r = 0.04. However, any trajectory with 
an initial condition starting just to the left of (1,0) in either picture becomes 
unbounded. While this is an acceptable conclusion when the origin is unsta- 
ble, it does not make sense when the origin is stable. To see this, consider the 
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initial condition (.6,0). In both pictures, this trajectory becomes unbounded. 
However, if we consider the initial condition (.1,0), we observe that it become 
unbounded for r = 0.04 but clearly approaches the origin when r = —0.04. If 
we trace the trajectory backward in time for r = —0.04, we see that it came 
from an unstable limit cycle. Thus we conclude that our system has un- 
dergone a subcritical Hopf bifurcation. 
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FIGURE 6.14: (a) Phase plane plot of trajectories for r = —0.04, p = 0.2; 
(0,0) is a stable spiral and an unstable limit cycle is present. (b) Phase plane 
plot of trajectories for r = 0.04,p = 0.2; (0,0) is now an unstable spiral. 
Although the trajectories in both (a) and (b) spiral in the same way, the 
stability of the origin helps us “observe” and infer the unstable limit cycle in 


(a), passing through about (.4, 0). a 


From Example 3, we can see that it often takes trial and error in finding 
numerical values that will confirm our analytical conclusions. Observing limit 
cycles can be a balance between parameter values that are too close to the 
bifurcation values to observe this phenomenon and parameter values that are 
too far away and other things have already changed. It turns out that we 
still have an unstable limit cycle for r = 0.05,p = 0.2 but it has already 
disappeared when r = 0.06 through an entirely different bifurcation—a ho- 
moclinic bifurcation in which the limit cycle grew in amplitude but was 
destroyed when it touched the other equilibrium point (1,0). 

We briefly present an alternative approach to determining the presence 
of a Hopf bifurcation in a 2-dimensional system. Recall Theorem 6.1.1 and 
Figure 6.5 that determined conditions on a linear system. We know that a 
supercritical or subcritical Hopf bifurcation occurs when the spiral equilibrium 
point changes stability. Thus, we must be crossing the 3 = 0 line for y > 0. 
Revisiting Example 2 of this section, we had 


xo,)=|" f), 


r 
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so that our alternative approach requires 
B=2r=0, y=r*+1>0. 


This gives the same condition r = 0 as previously found (the equation on 7 
is always satisfied). Revisiting Example 3 of this section, we had 


30,0)=| ° ?I. 


r 
so that our alternative approach requires 
B=r=0, y=p> 0. 


This gives the same conditions r = 0 and p > 0 as previously found. In 
both cases, we still need to numerically find the limit cycle on one side of the 
bifurcation value but this approach is sometimes easier. 

We can also have \ = 0 and Hopf bifurcations occurring in the same prob- 
lem and we explore this more in the problems. 


Problems 


In Problems 1-8, determine the type of bifurcation that occurs. Confirm your 
analytical results with qualitatively different phase portraits before and after 
the bifurcation. If instructed, draw the bifurcation diagram as well. 


P 2 ee one I gy ed 
Teme x 2. {7 Y-a@ 


yury y =rx-y 
3 a = re — 2 A w= ry — 2 
y=a-y y=a-y 
ental 6 {yore 
YY Sy y=—Y 
av’ =ra+2y a’ =ra+2y 
7. ioe 2 8. fio 8 
y =—2e+ry+x-y y =—2xe+ry— xy 


9. Consider the oscillator described by 
a” +2! (a7 —e) +2 =0, (6.36) 


where x = x(t) ande € R. Show this system undergoes a Hopf bifurcation 
when ¢€ = 0. What type of Hopf bifurcation is it? 


10. Another famous nonlinear differential equation is the double-well oscilla- 
tor 
go” +ere’ —2+a°=0. 
Using the methods of Section 3.4, convert this equation to a system of two 
first-order equations. Find and classify any 4 = 0 or Hopf bifurcations 
that occur. Draw phase portraits for « = 0,0.25,1 and describe any 
differences. 
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11. Consider the system given by { af be ge) with f(0) = g(0) =0 
and fz (0) = fy(0) = gz(0) = gy(0) = 0 and the quantity 


i 
b= 16 [fuxz + fryy + Gxxy + Iyyy] (6.37) 
1 
+ T6b [fey (fee + fuy) — Guy (Jax + Syy) — fea Gnre + Fuvduyl , 


where the partial derivatives are all evaluated at (0,0). It is shown in 
[27] that the system will undergo a supercritical Hopf bifurcation if w < 0 
and a subcritical Hopf bifurcation if 4 > 0. Use this to show that the 
xv’ =ytra, y! = —x+ry—27y undergoes a supercritical Hopf bifurcation 
when r = 0. 


12. Consider the Lorenz system 


where o,r, @ are positive parameters. 
(a) Show that the origin is always an equilibrium solution with eigenvalues 


(o+1)+ Vo? —-20+1+4ro 


Mi = —¢, A2,3 = 2 


(b) Show that the two additional equilibria are given by (a*,y*,2*) = 

(/o(r _ i); Vor I) 1), ( Volr I), Volr 1); r 1). 

(c) Show that the origin undergoes a supercritical pitchfork bifurcation 

atr=1. 

(d) Show that each of these additional equilibria undergoes a subcritical 

3 

ren With o = 10,¢ = 8/3, look 
P=o= 

for the unstable limit cycle in this three-dimensional system by starting 

close to the equilibrium solution for r slightly smaller than r.. You will 

see that initial conditions close enough to the point will approach it while 

those just slightly bigger will go away from it. 


Hopf bifurcation when r, = 


6.4 Epidemiological Models 


This section deals with the interaction of groups of people in an effort 
to better understand the spread of a certain disease. There are a myriad of 
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mathematical models that can be used to describe the spread and transmission 
of a wide range of diseases. Most of the framework in epidemiology consists of 
dividing the population under consideration into various classes. Each class 
defines the state of the individual in reference to the disease being modeled. 
These classes typically consist of three groups: those that are susceptible 
to the disease, those that are infected with the disease, and those that are 
recovered from the disease. A model with only these three classes is called a 
Susceptible-Infected-Recovered (SIR) model. The type of mathematics that 
is used or implemented in the model is determined by the rules governing or 
describing the movement of individuals from one class to another. In the SIR 
model, individuals move from the susceptible class to the infected class to 
the recovered class depending on their interactions with infected individuals 
and on their bodies’ ability to fight the disease. There are many variations 
of this model. For example, the recovered individuals may be permanently 
immune from the disease (e.g., measles) or they may have temporary immunity 
or no immunity and be susceptible again to the disease (e.g., syphilis). In 
the latter case, there are no recovered individuals as everyone who has been 
cured becomes immediately susceptible. However, in the case of temporary 
immunity the recovered individuals eventually become susceptible again. 

In this section, we will formulate the well-known SIR model and some vari- 
ations, discuss the rates of transmission and recovery, and mathematically 
analyze the resulting model. We will find the equilibria of the system, deter- 
mine their stability, and examine whether any bifurcations are possible. The 
topics from Section 6.2 will help us understand the effect of a disease on the 
population and give us insight into the key parameters driving the spread of 
this disease. 


A Model without Vital Dynamics 

We consider a simple model in which individuals do not enter or leave the 
system through natural birth or death (or immigration or emigration). A 
disease that spreads rapidly through a population is a good candidate for this 
framework. Pioneering work in epidemiology was done in 1927 by Kermack 
and McKendrick [25] in their study of the Bombay plague of 1906. They 
divided the population into S(£) = number of susceptible individuals, I(t) = 
number of recovered individuals, and R(t) = number of removed (or deceased) 
individuals. They made three basic assumptions about the disease: 


1. It traveled quickly through the population and thus no people were able 
to leave or enter the system. There are no births, deaths, and no immi- 
gration or emigration. In epidemiological terms, this is a model without 
vital dynamics. 


2. When an infected individual encounters a susceptible individual, there is 
a probability, 6, that the susceptible individual will get the disease. This 
occurs in proportion to the numbers of individuals in the infected and 
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susceptible classes. This is referred to as standard incidence.* 


3. Infected individuals recover at a constant rate, a.4 


With these assumptions, we can write the following set of equations: 


dS vi 

a oe 

dl I 

Se — G29. a] 

Fra allie 

d 

07 (6.38) 


where N = S$+IJ+R is the total population and S(t), I(t), R(t) > 0; see 


gis 


FIGURE 6.15: Flowchart for SIR model without vital dynamics. This 
diagram illustrates the movement of individuals from one class to another. 


We will typically refer to 6 as the transmission rate because it is the average 
number of contacts per unit time sufficient for transmission of the disease, that 
is, B contacts probability of transmission 
is, B= x 

° unit time contact 


to as the average number of adequate contacts. Thus the average number 
of contacts that a susceptible individual has with infectives per unit time is 
given by GI/N. The number of new infections per unit time in a susceptible 


. Sometimes 3 is also referred 


community with S individuals is [| S. Since a is the recovery rate, the 


average length of time an individual will remain infected is given by 1/a. 
If we multiply the average number of adequate contacts 6 by the average 
infectious period 1/a, we get the “average number of adequate contacts of 
a typical infective during the infectious period” (from Hethcote [21]). It is 


3For smaller populations it is sometimes better to consider a contact rate proportional to 
the total population and this is referred to as mass action—the interaction term in (6.38) 
would then be (ST. 

4Tf we let u(t) represent the proportion of infected individuals remaining at t time units, 
then we can write u’ = —au. The solution is u(t) = u(0)e~® and thus the fraction that 
is still infective after t time units is e~°’. If we think of this in terms of probability, we 
see this is an exponential distribution and thus the average length of the infective period is 
1/a. 
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sometimes useful to consider only fractions of a population and we can do so 
with this model by introducing new variables:>? s = $/N,i =I/N,r = R/N. 
This is just a special case of non-dimensionalization from Section 2.4. In the 
current model (6.38), we can divide both sides of the three equations by the 
total population N and thus obtain 


d 
ai = —Bsi 

“ = Bis — ai 

d 

7 = at. (6.39) 


The variables under consideration will satisfy 0 < s,i,r << lands+i+r= 
1. Model (6.39) is often easier to deal with both in terms of interpreting 
the results and from a numerical point of view. It allows us to consider 
relative changes in the population size. Mathematically, the two formulations 
are equivalent. Homework Problem 6 requires the reader to go through this 
derivation. 

Since the total population is constant we have 


si +i +r’ =0, 


and we can reduce the dimension of our system to two by substituting r = 
1—s—1. We thus arrive at the equivalent yet simpler formulation 


ds . 
a — si 
“ = Bis — ai. (6.40) 


Our solution can now be examined in R? rather than R?. We could solve these 
equations analytically by considering di/ds = i’/s' but we will instead use the 
linearization methods covered in Section 6.2. We can observe that there is an 
entire line of equilibria with 


i* =0,s* = arbitrary. 


This makes sense as whatever fraction of susceptible people that remain when 
the final infected person recovers will always remain susceptible. We are 
interested in understanding how the disease spreads across a completely sus- 
ceptible population and thus s* = 1 is the equilibrium with which we will be 
concerned. This equilibrium point in which there are no infected individuals is 


5We use i as the fraction of infective individuals and caution the reader to not confuse it 
with the imaginary 7 = /—1, which will sometimes arise as an eigenvalue in these problems. 
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known as the disease-free equilibrium (DFE). We calculate the Jacobian 
matrix of (6.40) as 


—Bi —Bs 
| - z B | (6.41) 
and evaluate it at the DFE to obtain 
0 —8 
hee : (6.42) 


We can use the trace and determinant to determine its stability. Here we have 
Tr(J(1,0)) =B-a, det(J(1,0)) =0 


for (0,0). The latter condition shows we will have a borderline case. Even so, 
we will proceed in order to gain an understanding of how the solution behaves 
in the remaining eigendirection. If Tr < 0, then we are borderline between a 
saddle and stable equilibria, whereas if Tr > 0, then we are borderline between 
a saddle and an unstable equilibria. We summarize with 


DFE is stable when 6 <a 
DFE is unstable when 6 > a, (6.43) 


acknowledging that we still have a direction with no change (this will not 
happen when we introduce births and deaths). Recalling that @ is average 
number of adequate contacts for disease transmission and a is the recovery 
rate of infected individuals, we see that this stability condition for the DFE is 
believable. The disease will spread if the average number of adequate contacts 
B is larger than the recovery rate a. Mathematical epidemiologists often con- 
sider the basic reproductive number, Ro, which gives the average number 
of infections caused by one infected individual over his/her period of infection 
as an equivalent method of determining if a disease will spread. Thus Rp < 1 
says that, on average, an infected individual infects less than 1 individual (for 
example, 10 infected individuals might only infect 7 others before recovering). 
Thus the disease will eventually die out. Similarly, Ro > 1 says that, on 
average, an infected individual infects more than 1 individual (for example, 
5 infected individuals might infect 8 others before recovering). In this latter 
case, the disease will spread through the population. If Rg > 1, we say that 
there is an epidemic. 

The mathematical epidemiologists examine the stability conditions for the 
DFE and determine which condition or conditions will first cause it to become 
unstable. When considering Ro, the stability conditions are rewritten in terms 
of Ro such that 


Ro <1 <— DFE equilibrium is stable 
Ro >1 <— DFE equilibrium is unstable. (6.44) 
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In our case, there is only one condition that will cause a change in stability. 
Our goal is to manipulate that expression so that Ro = 1 corresponds to 
the switch in stability. In our current example, we can manipulate (6.43) to 
obtain 


Ry ==. (6.45) 


Following the conditions in (6.44), the DFE is stable if B < 1 and unstable 
if Z > 1, which is just what we previously found.® 

In the exercises, you will show that when a small number of infective indi- 
viduals are introduced into a susceptible population, 


- ey e) (6.46) 


1—s* 


While it is usually not hard to determine the average length of the infection 
for a given disease, without this approximation it can often be difficult to 
determine the number of adequate contacts. 


| Example 1: | Consider a geographically isolated college campus and sup- 


pose 95% of the students are susceptible to the influenza virus at the beginning 
of the school year [9]. By the end of the year, many had become sick with 
the flu and only 42% were still susceptible after the flu had run its course 
on campus. Estimate the basic reproductive number for this flu and deter- 
mine if there was an epidemic. How might this epidemic have been prevented? 


Solution 
Since 42% of the individuals were still susceptible after the flu was gone, we 
see that s* = .42. Similarly, we see that s(0) = .95. Thus we see that 


and there was indeed an epidemic on the campus. Preventing the epidemic 
would require us to alter some of the values in the formula for Ro. For exam- 
ple, if we were to restrict the interactions of the students (which may or may 
not be practical), we could change the contact rate, thereby lowering Ro. We 
also could have vaccinated individuals at the start of the year. This would 
lower the initial number of susceptible individuals and would also reduce the 
number of students that had the flu. In this latter situation, we should note 
that we can’t selectively vaccinate those students who will end up getting sick 


because we don’t know in advance who will get sick. = 


6Problem 9 examines an equivalent formulation of (6.44)-(6.45) when we don’t normalize 
the equations: DFE stable <> eu < z. 
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A Model with Vital Dynamics 


We now consider a somewhat more realistic model by allowing natural births 
and deaths in the population to occur. We again let S represent the number 
of susceptible individuals, J represent the number of infected individuals, and 
R represent the number of recovered individuals. We assume that the death 
rate and birth rate are the same so that there is no change in the overall 
population. Denote this rate as uw > 0 and let N= S+J1+R again represent 
the total population. We assume that all individuals are born susceptible to 
the disease even when they are born from an infected individual. The number 
of births from the susceptible class, the infected class, and the recovered class 
are defined as 4S, ul, and wR, respectively. Thus uN is the total number 
of births or newcomers into the susceptible class. Similarly the number of 
deaths in each class per unit time are given by wS, ul, and wR, so that the 
population level remains constant. If we again make assumptions 2 and 3 
from the previous model, our diagram is shown in Figure 6.16. 


UN 


FIGURE 6.16: Flowchart for SJR model with vital dynamics. 


The corresponding equations are 


ds I 
= uN 
daa oe N ° 
dI I 
oF B N S-—oal—pl 
dR 
a = * wR (6.47) 


This is called a SIR model with vital dynamics. Because N is constant, we 
can reduce the system to only two equations. If we consider the normalized 
populations of s = S/N,i = I/N,r = R/N, we can rewrite the governing 
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equations as 


ds ; 
eT 8 Bis 
“ = Heal ie (6.48) 


(The reader should convince him/herself that this can be done; see homework 
Problem 7.) We have two equilibria (s*,i*) for this system, 


(1,0) and (se ). (6.49) 


We have seen the first equilibrium point before—it’s the DFE in which there is 
no disease and everyone is susceptible. The latter is new to us—it is called an 
endemic equilibria (EE) and represents the population levels if the disease 
persists. 

It is very important to observe that the EE only makes sense biologically if 


i* >0, ie., if 


> a The Jacobian of the system can be calculated as 
[i 


Ob 
ny _[-Bi*—p —Bs" 
J(s*,*) = | Br Bera ochig (6.50) 
Evaluating the Jacobian at the DFE gives 
Bh Bp 
J . 6.51 
HE Gb eal (6.51) 


We calculate the eigenvalues here instead of using the trace and determinant 
because the former is easier in this case since we have a triangular matrix. 
The eigenvalues for the DFE are 


At = —-p, A2 = b-(atp). 


Since » > 0 the DFE is a stable node if 8 < (a +p) and is a saddle point if 
B > (a+ yp). Based on these stability conditions the DFE switches stability 
when 8 = a+u. From this we can conclude that the basic reproductive 
number is 
Ro= B 7 (6.52) 
a+ pb 
This says that the disease will die out as long as the contact rate is less than 
the recovery rate plus the death rate (i.e., Ro < 1). This should be believable 
because in order for the disease to persist, there should be at least as many 
people coming into the infective class as there are leaving it (due to death or 
recovery). 
We noted above that the HE will only exist if 7* > 0, i-e., if an > B This 
condition can be rearranged to say that 


“w>O0 = Batu. 
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This is exactly the condition for the instability of the DFE. It is no coinci- 
dence that the EE becomes biologically relevant at the instant when the DFE 
becomes unstable! We leave it as an exercise for the reader to show that 


EE is a saddle point (and not biologically relevant) when Rp < 1, and 
EE is stable (and biologically relevant) when Ro > 1. (6.53) 


We can take sample parameter values to show some of the plots. In Figure 
6.17, the parameter values are chosen as 3 = .8,a@ = .4,y. = .05. This would 
correspond to an average infectious period of 4 = 2.5 days and an average 
lifetime of + = 20 days.’ These values give a basic reproductive number that 
is less than 1 and thus the EE is not biologically relevant. We note in Figure 
6.17 that while mathematically we can choose any values for s and 7, their 
biological meaning requires us to only choose values where s +i < 1. 


B 0.3, a O.4, pe 0.05 Ro =0.66667 


i 


s +i > 1 in this region, 4 
which is not biologically possible 


fraction of infected 
° ° 
a a 


0.3 


oO 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 
fraction of susceptible = s 


FIGURE 6.17: Only the DFE is biologically relevant. Ro < 1 and the 
DFE is stable. 


If we increase the contact rate to 6 = .6, we obtain an FE that is biologically 
relevant and stable. The DFE is a saddle for these parameter values and Ro > 
1. The previously used value of js = .02 is necessary in order to graphically see 
the equilibria above the horizontal axis. (The reader should refer to Equation 
(6.49) to calculate the location of the EE for these parameter values. However, 
even for realistic values of yw, the HE will exist and be stable whenever Ro > 1. 
See Figure 6.18, which contains the solutions in the phase plane and the 
corresponding time series plots for one of the solution curves. 

We must again impose the mathematical restriction that s+7 < 1 since our 
total normalized population cannot exceed 1 (and we know that r = 1—s—i). 
In Figure 6.18(a), we see that solutions are spiraling into the HE. Mathemat- 
ically, we can show that the FE is a spiral sink. Biologically, the damped 


’The value ys = .05 is an unrealistically low value that is used only to be consistent with 
Figure 6.18. The reason will be justified then. 
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6 =0.6, « =0.4, p =0.05 > Ro =1.3333 8 =0.6, « =0.4, 1 =0.05 = Ro =1.3333 


s+i> Lin this region 
which is uot biologically possible 


s(0)=.9, i(0)=.1 


Initial conditions 


a] 


i(t) =fraction of infected individuals 


(a) x fe oa : ra (b) % 50 den 100 150 
FIGURE 6.18: (a) Phase plane plot of numerous solutions; the DFE is 
located at (s*,7*) = (1,0); the EE is at (s*,i*) = (.75,.027778). (b) Time 
series plot for the initial condition s(0) = .9,i(0) = .1. 


oscillations we see in Figure 6.18(b) can be interpreted as the effect of the 
mass action law together with the vital dynamics: the more susceptibles there 
are, the greater the likelihood of adequate contacts thus resulting in more in- 
fections. This results in a decrease of susceptibles in the next time period. 
The reduction in the fraction of susceptibles that results from more infections 
makes it less likely for an infective individual to have an adequate contact 
with a susceptible and infect. This will then allow for more susceptibles in 
the next time period and so on until a steady state is reached. 


We go back again to the basic reproductive number to give one additional 
interpretation of it. Let’s rewrite this as 


eee je 


We said that @ can be interpreted as the average number of susceptibles 
infected by infectious individuals per unit time. By a similar argument given 
in the footnote in the derivation of Equation (6.38), we can interpret 


1 
a+ pb 


as the average length of the infectious period. Thus Ro is the number of infec- 
tions caused by an infected individual during her/his period of infectiousness. 
The interested reader is again encouraged to examine the texts mentioned at 
the beginning of this section for a more in-depth look at mathematical epi- 
demiology. 


Bifurcations in Epidemiological Systems 


Recall that a bifurcation is a qualitative change in the system, often due to a 
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change in the number or the stability of equilibria. Using the information in 
Sections 2.3.2 and 6.3, we see that the DFE and EE underwent a transcritical 
bifurcation where the FE passed through the DFE as it became biologically 
relevant and the two switched stability. This is typically what happens in 
an epidemiological system. For larger epidemiological systems involving more 
classes, the EE is often very difficult to obtain as a closed-form expression. In 
such cases, the existence of an EE is often deduced from the switch in stability 
of the DFE through a transcritical bifurcation! The analytical results can then 
be confirmed numerically. 

In plotting the transcritical bifurcation curves, we plot each one of the equi- 
librium points’ coordinates, s* or i*, as a function of one specific parameter. 
When it is feasible, we consider Ro as a function of the parameter we are 
varying and plot Ro as the horizontal component (instead of a specific pa- 
rameter of the model). This allows us to see that the transcritical bifurcation 
occurs when Ro goes through 1, with the EE becoming biologically relevant 
and stable. For example, consider the coordinates of the EE in the model 
given in Equation (6.48), 


w= (G4 a Hy. 
Bae 8 


We can rearrange terms and manipulate the expressions to make them explicit 
functions of Ro: 


(s*,2") = (G4 (m%-0). (6.54) 


This gives a line in the Ro-i plane. If we also plot the curve produced by 
the 2* coordinate of the DFE, i* = 0 (a horizontal line in the Ro-i plane), we 
obtain the plot in Figure 6.19. 


DFE stable 


-* DFE unstable 


° 1 
Ro 
FIGURE 6.19: Bifurcation diagram plotted in the Ro-2 plane. A trans- 
critical bifurcation occurs because the DFE and EE switch stability as the 


EE becomes biologically relevant. 


While the transcritical bifurcation is the typical way for the EE to gain 
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stability, it is sometimes part of another bifurcation curve (a saddlenode bi- 
furcation curve). In these situations, we can have a backward bifurcation 
and the KE can exist even when Rp < 1. This means that continuously vary- 
ing the parameters back to their preepidemic values may not be enough to 
get rid of the epidemic. This phenomenon is known as hysteresis and is also 
observed in many physical systems [48]. 


Mathematical Modeling 


We take a moment to consider various branches of mathematics that can be 
used to study the spread of epidemics in a population. As with all mathemat- 
ical models, there are limitations and not all details can be incorporated into 
the model. We need to make many assumptions in order to create a man- 
ageable mathematical model that captures the key components of the disease 
under consideration and allows for new insight of the disease. 


e Ordinary differential equations assume a continuous population variable 
and thus work well when there is a large population of people. Much 
information can be obtained from these models but answers do not have 
to be whole numbers. This is the specific branch that we studied in this 
section. 


e Partial differential equations are commonly used for large populations 
when we want to keep track of multiple characteristics of a person that 
may change. For example, we may consider a SIR model with age 
structure in which we also keep track of the age of the individuals within 
each class. 


e Difference equation models are often used to describe epidemics in which 
either the population or time is considered discrete (e.g., may be sea- 
sonal). For example, one may look at generations of mosquitoes that 
carry a certain disease and examine how the disease passes through the 
population over many generations. These models can often be used if 
we do not want to consider a continuous population variable but want 
whole numbers instead. These models can also arise as a discretization 
of one of the continuous models above. For example, if we wrote down 
the formulas for solving the system using the fourth-order Runge-Kutta 
method for a SIR model, we would have a difference equation model. 


e Stochastic processes may be used for models in which we want to con- 
sider a discrete population and time. A key difference between this type 
of mathematical framework and the previous is the assumption of ran- 
domness in one or more of the parameters. That is, at each step there 
is a probability that something will happen but it is not guaranteed. In 
this type of model, beginning with the same initial state of the system 
may yield different results every time. This is in direct contrast to the 
previous three deterministic approaches in which a given initial state 
will always result in the same outcome. 
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e Network models use graph theory to understand how individuals are 
connected with each other and thereby gain a better understanding of 
how the disease spreads through a given community. By focusing on 
key individuals that are well connected to others in the population, the 
spread of the disease can be controlled. 

e Agent-based models are becoming increasingly common because of the 
large-scale computer simulations that arise from them and their ability 
to differentiate between individuals in the same class. In this type of 
model, a set of characteristics is used to describe each individual and 
thus each movement and interaction can be tracked. Based on these de- 
scriptions, a large-scale computer simulation can be done by considering 
a city of 500,000 people and watching how the interactions of the people 
can affect the spread of disease. These simulations have become popu- 
lar with the threatened use of biological weapons in heavily populated 
areas. 


Each type of modeling has its place and one needs to carefully choose the ap- 
propriate mathematical framework from which to model and analyze a given 
epidemic. The interested reader should examine Hethcote [21], Daley and 
Gani [15], and and others for additional details of the subject of epidemiol- 
ogy. In this book, we consider only models of ordinary differential equations. 
These are perhaps the simplest to understand and the ones in which we can 
carry the mathematics the furthest. Even though a number of assumptions 
will be required to formulate these models, the results can often shed tremen- 
dous insight on the behavior of individuals, their interactions with each other, 
and the overall effect of the disease on the population. These models can also 
give researchers insight on how to control the spread of a disease; mathemati- 
cal models can sometimes indicate whether it is possible to eradicate a disease 
from the population (e.g., as happened with smallpox) or whether there is lit- 
tle or no chance of doing so. Variations of the basic SIR model are explored 
in the Problems, such as in Chapter Review Problem 34 that explores the 
SIS model (where recovered individuals are again susceptible) and Problem 
13 in this section that explores the SEIR model (where an additional class of 
individuals exist that have contracted the disease but cannot yet infect others, 
that is, they are not yet infectious). 


e e e e e e e e e e e e 


Problems 


1. Consider Example 1. Assuming that the infective period of the flu is 
about 3.5 days, determine the adequate number of contacts required for 
the disease to spread. 

2. Again consider Example 1 and suppose that a vaccination strategy is 
implemented at the beginning of the school year. Determine what per- 
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centage of students must receive the vaccination in order to make Ro < 1. 
You may assume that if 10% of the students are vaccinated, then only 
.95 x .9 were initially susceptible and .42 x .1 would not have developed 
the flu even though they received the vaccination. Is this assumption 
reasonable? Explain. 


. In this exercise, we use (6.40) to obtain (6.46). 


(a) Find an implicit solution to (6.40) in which time is not explicit by 
solving di/ds = i'/s'. Write this solution in the form f(s,7) = c. 

(b) Observe that your implicit solution f(s,i) = c describes the evolution 
of the disease for a given initial condition. Show that f(s(0),i(0)) = 
f(s", 7*). 

(c) Use the initial approximations s(0) + 1 and i(0) = 0, and the limiting 
values (after the disease has passed) i* = 0, s* = 0, along with your 
answers in parts (a) and (b) to obtain 


It is important to check that a given epidemiological model is a well-posed 


one. 


That is, there should exist a forward invariant set (a region of phase 


space) in which a solution in the region cannot leave it for any t > to. In the 
case of a fixed population, we need to have the total number of individuals 
remain constant and none of the variables should ever become negative-valued. 
Use this information to answer the following two questions. 


4. 


(a) By substituting s = 0 into (6.40), show that no individuals will be 
able to become infected. 

(b) By substituting i = 0 into (6.40), show that no individuals will be 
able to become infected without infected individuals. 

(c) Use s +4 <1 and your results from (a) and (b) to conclude that 


{(s,i)]0<s,0<i,s+i<1} 


is a forward invariant set and the model is thus well posed in the first 
quadrant. 


. (a) By substituting s = 0 into (6.48), show that the susceptible population 


cannot become negative. 

(b) By substituting i = 0 into (6.48), show that no individuals will be 
able to become infected without infected individuals. 

(c) Use s +4 <1 and your results from (a) and (b) to conclude that 


{(s,a|0< 5,0<i,s+i< 1} 


is a forward invariant set and the model is thus well posed in the first 
quadrant. 
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6. Derive the normalized model without vital dynamics, (6.39). 
7. Derive the normalized (reduced) model with vital dynamics, (6.48). 


8. Consider an illness that is passing through an isolated college campus 
that is on the quarter system. Assume that students that get the illness 
can function okay for a while but then often have to drop out for the 
remainder of the quarter because they are falling too behind in their 
work. Thus we have susceptible individuals, infected individuals, and 
drop-outs (that are removed from the population and are assumed to no 
longer have contact with any enrolled student). Our model can be written 
as the SIR model without vital dynamics 


dS I 
ad PN? 

dl I 

a“ = ai, (6.55) 


where S and J have their normal meaning and R stands for those students 
that are removed from the population, i.e., that have dropped out. Our 
goal is to normalize (6.55). - 
(a) Define N = $+ as the currently enrolled population and N = 
S+1+ as the total population. Decide if the variables N and N are 
constant or dependent on time. Explain why s = S/N, i = I/N, and 
r= R/ N are the appropriate choices for the new variables. (Note that 
the denominator in the r-variable is different.) 

(b) Explain why N/N = (1—r). 

(c) Use the definitions from part (a) to rewrite model (6.55) as 


= —(si+ ais 

“ = Bis — ai + ai? 

d 

— =ai(l—r). (6.56) 


Note that this is not the same as (6.39). 

(d) Analyze this new system, (6.56). 

This normalization technique has also been used in a model of college 
drinking by Almada et al. [2]. 


9. Consider the basic STR model without vital dynamics (6.38). This prob- 
lem derives an alternate form of the basic reproductive number in the 
situation where we don’t normalize the variables. 

(a) Reduce the system to two equations (in J and R). 
(b) Find the one equilibrium solution and classify its stability. 
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10. 


11. 


12. 
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(c) Use (b) to derive an equivalent formulation for stability of the DFE: 


Consider the model given by (6.47) with a constant influx, A, of people 
into the population 


dS I 
qe BF 
dI I 

a BS al — pl 
dR 


By adding the equations together, obtain an expression for N’(t), where 
N=S$+4+I1+R. Solve this equation and describe the population level as 
t> oo. 

Consider the model given by (6.47) in which susceptible individuals can 
be vaccinated at a rate v 


dS I 
eo IN pS 
qe TUN - (ut v)S — Ba S 
dI I 
= I I 
ay 
d 
= =al—pR+vS. (6.58) 


(a) Show that the population level remains constant. 

(b) By considering only the first two equations (justified by your result 
in part (a), compute the DFE. 

(c) Determine the stability of the DFE. 

(d) From your results of part (c), find an expression for Ro and give an 
interpretation of it. 

An article by researchers at Princeton in early 2014 suggested that Face- 
book will lose as many as 80% of its users by 2017 [14]. They modified 
the basic STR model without vital dynamics to include what they called 
infectious recovery dynamics: 


ds j 
a °° N 

dl i R 

Ae 

dR R 


where S represents individuals who have never used Facebook, J are those 
who currently use Facebook, and R are those who previously used Face- 
book but have now quit. 


13. 


14. 
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(a) Show that overall population in (6.59) remains constant. 

(b) Write an equivalent system of two equations that does not contain S. 
(c) Show that (1*, R*) = (0, R(0)), (NV, 0) are the two equilibria and clas- 
sify their stability. 

(d) Use (c) to show that the stability condition for (0, R(0)) is given by 


S(0) a 


RO) ~ B 


and compare your result to that of Problem 9. 

(e) Assuming that the stability condition you obtained in (d) holds, deter- 
mine what is predicted to happen to the Facebook population as t + oo. 
(f) The researchers obtained the estimate of “80% by 2017” by fitting the 
model to the data in order to estimate the parameters 6 and v. If in- 
structed, find the article and comment on the shortcomings of the model, 
including from where the infectious and recovery rates were estimated 
as well as whether a model without vital dynamics is the best choice of 
models. 


Many diseases, such as tuberculosis, HIV, and Ebola, have an exposed 
period (or latent period) in which the susceptibles have contracted the 
disease but have not yet developed symptoms and cannot transmit the 
disease. After a period of time, they become infectious and are then able 
to transmit the diseases to susceptible people. 


~ = BS + uN LS 

= B= BE —6E 

a =dE-pl—yI 

a“ = 71 - wR. (6.60) 


(a) Show that the total population N = $+ #+J+R remains constant. 
(b) Calculate a simpler system involving only three equations. 

(c) Find Ro for this simpler system and give an interpretation of it. 

An HIV model by Perelson [41] proposed the following model for the 
dynamics of blood (lymphocyte) concentrations: 


dT ih 

—=s+pT {1 kVT —aT 
dt max 

al _vr—sr 

dt 

: 

== NOE = 

Ti OL =4V, 
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where T is the uninfected T-cell population, J is the infected T-cell pop- 
ulation, and V is the virus concentration. For the parameters, a > 0 is 
the rate of death per uninfected cells, 6 is the rate of death per infected 
cells, y is the rate of death of the virus, & is the infection rate constant, s 
represents the external production of T' cells, p is the growth rate (for the 
assumed logistic growth), and N is the number of virions produced by 
each infected cell during its lifetime. With no virus, the T-cell equation 
has a stable steady state T = wets » -at je —a)?t+ _ . The 


Max 


basic reproductive number is known to be 


k— 
Ro = -TN. 
y 
(a) Derive this quantity and give a biological interpretation of it. 
(b) Numerically investigate the number and stability of the equilibria for 
Ro <land Ro > 1. 


6.5 Models in Ecology 


This section deals with additional applications of systems of nonlinear dif- 
ferential equations to populations of animals. As with epidemiological models, 
there are numerous mathematical approaches that may be used and we will 
consider only models with ordinary differential equations. We begin with the 
classical model describing the interaction between two species: a predator and 
its prey. This model was originally proposed by A. J. Lotka and V. Volterra 
in the 1920s and is now referred to the Lotka-Volterra model. Although this 
model is simplistic and it is easy to find weaknesses in it, it is still a valuable 
example to study. Many populations in the wild oscillate as do a number of 
other phenomena such as the auto industry (in fact there is a whole industrial 
sector called cyclicals). The predator-prey model is a theoretical model in the 
sense that while it may not predict correct numbers, it proves that conditions 
can be formulated which lead to stable oscillatory behaviors. 


Lotka-Volterra Predator Prey Model 


We begin with the model assumptions, simplifications, and notation: 
1. There are two species interacting: a prey species x and a predator species 
y. For the purposes of this model no other species interact with these 
two. 


2. In the absence of the predator, the prey exhibits pure exponential growth. 
In particular — = ax where a > 0. Implicit in this assumption is that 
there is sufficient food and space to allow the prey species to grow indef- 


initely. 


6.5. Models in Ecology 471 


3. In the absence of the prey, the predator species dies out exponentially. 
In particular, ay = —dy where d > 0. Thus although it is not explicitly 
mentioned, there is other food for the predators, but not enough to sustain 
the population. Thus it dies out over several years rather than over a 


month or two. 


4. When the two species are in the presence of each other, the predators kill 
the prey in such a way that the predator population increases at a rate 
proportional to the product of the number of predators and the number of 
prey (ie., zy). Similarly the prey population is decreased by an amount 
proportional to the product of the population sizes. This term captures 
the likelihood of an encounter. 


This xy term perhaps deserves some further discussion. Naively it makes 
sense that if either the number of predators or the number of prey increase, the 
number of interactions and hence deaths increase also. But why xy and not, 
say, x? Jy, or some other such function with the same properties? Originally 
this term was borrowed from chemistry models of rates of reactions where 
molecules in solution interacted by randomly bumping into one another [16]. 
The predator-prey assumptions yield the following system of equations: 


o =ax—bay=a2(a-—by) 
Y — cay —dy = (ex — A). (6.61) 


If b = c, this would mean that every eaten x corresponds to a new y. Thus, 
we should have b > c > 0 unless x and y have been rescaled so that this 
restriction is not necessary. We are interested in the long-term behavior of 
the system and calculate the equilibria of the system: 


da 
(0,0), and (¢ 5) . 


In order to determine the stability of these solutions, we calculate the Jaco- 
bian: 


Hay) =| 


and evaluate it at the respective equilibrium points. For the origin, we have 


J(0,0) = E a 


Here Tr(J(0,0)) = a —d and det(J(0,0)) = —ad. Since a and b are both 
positive, det(J(0,0)) < 0, and hence (0,0) is a saddle point. At (4,4) we 


have 
go 2) | 9 fal 
Cc b a 0 


a—by —bz« 
cy cx — d 
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Thus Tr(J (4,%)) = 0 and det(J(¢,4)) = ad > 0. Referring to Theo- 
rem 6.1.1, we have 6 = 0 and y > 0 which indicates that this equilibrium 


is a linear center. The (4, ¢) solution has trajectories circling about it in 
a counterclockwise direction; see Figure 6.20(a),(b). As this is a theoretical 
model, these are more or less arbitrarily chosen parameters. Figure 6.20(a) 
shows the predator and prey solution curves plotted as a function of time. 


Figure 6.20(b) plots these solutions on an xy phase plane. 


x(t)=black, y(t)=blue 


(a) 
FIGURE 6.20: Numerical solutions of system (6.61) with a = 1, b = 0.6, 
c = 0.4, and d = 0.3. (a) Predator and prey populations as a function of time. 
(b) Predator-prey trajectories plotted in the phase plane. 


The phase plane diagram verifies that the equilibrium is a linear center 
and is in fact a nonlinear center. Observe the following behavior on both 
graphs. When the predator population is low, the prey population starts to 
rise. Soon the predator population rises to the point that the prey population 
starts to drop. Even though the prey population is dropping, for a time the 
prey population is still high enough that the predator population continues to 
rise. At a point, the prey population drops so low that the predator population 
can no longer be maintained and it starts to drop. Both populations drop until 
the predator population is low enough that the prey population begins to grow 
again and the cycle repeats. From the graphs, one can even determine the 
predicted period of the cycle. 

The work up to now has been a general technique which applies to any sys- 
tem of two differential equations. The analysis from this point on depends on 
the particular form of these equations. In particular, the linearized equations 
are combined to form a single separable differential equation. This is used to 


8A linear center refers to one predicted by the Jacobian but where the inclusion of linear 
terms may change this result. A nonlinear center refers to a center that remains that way 
when the full system with nonlinear terms is considered. 
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analytically determine the shape of the trajectories near a center for several 
important cases. 

Going back to the information on linearization we see that if we translate 
the coordinate system, so that an equilibrium (a*,y*) is moved to the origin 
using the equations u = « — «* and v = y— y*, the system behaves near the 
origin according to the linearized system of equations. In particular, we had 


du * Ok * * 
am fale +Y ut fe 1Y ju 
dv * o* x Ok 
BIE ut gy(2" y")u 
in Equation (6.10). In the case of the predator-prey model, u = x — q 
v=y-—§, and 
du bd 
EAS at sf SN as 
dt cj’ 
dv | (“°) 
dé \b)" 
The chain rule from calculus gives 
du = du dt du b2dv 
dv dt du du ac? u ( ) 


The key to this analysis is that (6.62) is a separable differentiable equation. 
Thus 
ac?udu = —db?v dv. 


Integrating both sides yields 


ac?u? _ b? dv? ; 
rn ee 
Rearranging gives 
ac?u? 4 b? dv? C u 4 v? 
= or ——-+-—~= 
2 2 : b2d ac? 


This is, of course, the equation for an ellipse centered at the equilibrium with 
axes parallel to the coordinate axes. The implication is that close to the 
equilibrium, the trajectories look like ellipses, which confirms our prior deter- 
mination that the fixed point was a center. Indeed, close to the equilibrium 
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the trajectories are ellipses, further away they still oscillate about the equilib- 
rium, but with a more complicated shape. Interestingly the original nonlinear 
predator-prey equations can be solved in closed form to give the implicit so- 
lution (y* e~"¥)(a° e~@) = K, and the reader is referred to Olinick’s book 
[40] for a derivation. Olinick’s book was written in 1978, before computers 
became commonplace, and there are some interesting discussions about how 
to graph solutions such as (y* e~°Y)(a° e~) = K using drafting techniques. 


Many modeling books report a famed data set of Canadian lynxes and hares 
that appear to support this model. However, there has been much controversy 
over this data set. The data represent the trapping for fur, and there is a 
question about how well trapping data represent the true census (trends in 
fur prices might play a role in the number of animals trapped). An observation 
that at one point the rise and fall in the lynx population preceded the rise and 
fall in the hare population resulted in a paper by Gilpin entitled Do Hares 
Eat Lynaz? [17]. Hall points out, in a paper [19] that should be read by all 
aspiring modelers, that the data set represents hares from eastern Canada 
and lynx from western Canada (lynx furs were worth shipping but hare furs 
were not). In fact these populations were not interacting at all. Further, hare 
populations were seen to oscillate on Anticosti Island in a manner similar to 
hares on the mainland, but no lynx lived on the island. Great care must be 
taken when modeling if you are using data you have not collected yourself. 

In natural settings, it is very hard to observe a true predator-prey rela- 
tionship due to other factors that affect the populations. There are, however, 
examples of the predator-prey phenomena observed in experimental settings. 
One performed in 1957 by Huffaker studied two species of mite: one fed on 
oranges, the other fed on the other species of mite. The results agree favorably 
with the predictions of the predator-prey model. 


We now consider a modification of this model that uses a modified logistic 
function to model the prey. Recall the logistic function from Section 2.4: 


dN N 
=dV (1=— 
di” ( x) 


where N is the population, a is the intrinsic growth rate, and K is the carrying 
capacity. This models the population as growing exponentially for small pop- 
ulations and then approaching its carrying capacity. However, if we consider 
that small populations might have more difficulty in finding a mate, then a 


better model would be 
dN N 
——=aN* |1——). 
do ( Zz) 


This next example incorporates this idea into the classic Lotka- Volterra model [39], 
[48]. 
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| Example 1| Consider a modified version of the classic Lotka-Volterra equa- 


tion: 
dN N 
—— =aN?(1——)-—bPN 
dt K 
dP 


o~ = P(cN ~ 4), (6.63) 


where N is the prey population, P is the predator population, a is the intrinsic 
growth rate and K the carrying capacity of the prey, and b,c,d have the 
same meaning as discussed earlier. With five parameters in the model, it can 
become unwieldy but the technique of non-dimensionalization from Section 
2.4 allows us to rewrite the system as 


d 

; = 27 (1-2) -—ay 

dy 

pea a 64 

ap wuz — 9); (6.64) 
as you will show in the Problem 7 with 7 = x, y= oF T=akt,a= e 
and 6 = 4. 


We find equilibria of the system (6.64) to be (0,0), (1,0), and (4, 6(1 — 0)). 
Calculating the eigenvalues of J(0,0) gives \1,2 = 0,—a0d. An eigenvalue of 0 
does not allow us to conclude anything about the stability of the origin but we 
can overcome this by considering the cases 7 = 0 and then y = 0. Taking the 
former shows that the predator population will die off in the absence of prey 
(eigenvalue —ad). If we take y = 0 our model reduces to x’ = x?(1—2), which 
we can analyze on the phase line to conclude that for small initial population, 
it will increase to 1. Thus, (0,0) is a saddle. 

For the equilibrium (1,0), the eigenvalues of J(1,0) are A1.2 = —1,a(1—9). 
We know that 6 > 0 so this point will be a saddle when 6 < 1 and stable 
when 6 > 1. 

For the final equilibrium point, it will exist biologically only when 6 < 1 
since a > 0. When it does exist biologically, we can see whether a Hopf bifur- 
cation will be present. We use the alternative approach using the trace and 
determinant of the Jacobian shown at the end of Section 6.3, which requires 
8B=Oand y>0: 


B=6(1-26)=0, y=?a(1—6)>0. 


Thus, we may have a Hopf bifurcation when 6 = 4 (with the other condition 
6 < 1 not adding anything). If we look at phase portraits, we see that we 
have a stable limit cycle when we are just below 6 = $3 see Figure 6.21. Thus 
we have a supercritical Hopf bifurcation. Interpreting the plots of Figure 


6.21(b), we see that the population will reach a stable solution for any choice 
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of x,y > 0 and will approach this equilibrium in an oscillatory fashion. For 
certain parameters, Figure 6.21(a) shows that our populations may continue 
to oscillate (stable limit cycle). This is different from the basic Lotka-Volterra 
model in which we had an infinite number of nonlinear centers surrounding 
the equilibrium point. Although not shown here, our analytical work also 
allows us to conclude that if 6 = — > 1, that is, if the death rate of the prey 
is too fast (d), or if the conversion rate of prey to predators is too slow (c), or 
if the carrying capacity of the prey is too small, then the predator population 
will no longer exist and will die off. 
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(a) (b) 
FIGURE 6.21: Supercritical Hopf bifurcation in system (6.63). Negative 
trajectories are shown for mathematical completeness even though they do 
not make biological sense. (a) A stable limit cycle exists for a = 2, 6 = 0.4. 
(b) The stable limit cycle has disappeared for a = 2, 6 = 0.6 and (0, 6(1 — 6)) 
has become unstable. 


Lotka-Volterra Competition Model 
Besides modeling predator-prey systems, we can use our approach to model 
competitive systems as well. We revisit our previous assumptions and 


modify them as follows: 
1. There are two species interacting for the same food source: species x and 


species y. For the purposes of this model no other species interact with 
these two. 

2. In the absence of the other, each species will exhibit logistic growth. 

3. When the two species are in the presence of each other, only one will eat 
with the other seeking food elsewhere. 


Our modified Lotka-Volterra competition model can be written as 


dy _ oy (1 _ 4) aay, (6.65) 
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We highlight that interaction has a negative effect on both populations. We 
can find equilibria and stability in a straightforward manner and we summa- 
rize the trivial ones here (where either x or y or both are zero): 


(0,0): Eigenvalues \;,2 = a,c => always unstable (6.66) 

(0, Kg): Eigenvalues \;,2 = —c, (a — bK2) (6.67) 
= >> stable for a < bK2, saddle for a > bK2 

(11,0): Eigenvalues \; 2 = —a, (c— dy) (6.68) 


= > stable for c < dk, saddle for c > dk. 


For the non-trivial equilibrium 


Kic(a — bK2) Koa(c— dkj) (6 69) 
ac — bdK, Ko : ac — bdKk, Ko ‘ ; 
we calculate the trace and determinant instead: 
—bK —dk — dK —dk 
B= ac(a atc ) = ac(a 2)(c 1) (6.70) 
ac — bdK, Ko ac — bdk, Ko 
In order for it to be biologically meaningful, we require 
a—bK2, c—dkK,, and ac—bdk, Ko (6.71) 


to all have the same sign, either positive or negative. In order for this equilib- 
rium to be stable, we need 6 < 0 and y > 0. We observe that the numerator 
of 8 contains the sum of the first two quantities in (6.71) while the numerator 
contains the third. In order to have 3 < 0 we thus need all the quantities in 
(6.71) to be positive. All positive quantities in (6.71) will also make y > 0. 
Conversely, all negative quantities in (6.71) will make both 6 > 0 and 7 < 0 
and thus the non-trivial equilibrium point will either be a saddle or stable 
when it is biologically relevant. We can also observe that it will become bi- 
ologically relevant in a transcritical bifurcation with either (41,0) or (0, K2) 
and may enter as either a stable node or a saddle depending on the sign of 
the terms in (6.71). Note that we will always have at least one of (1,0), 


= —dk 
(0, A), and (=< oh) pode 4 stable. See Figure 6.22 for the 


ac — bdK, Ke : ac — bdk, Ke 
four cases that we have. Thus, we may have stable co-existence in certain 
situations or we may only have one species that survives. Stable co-existence 
requires both a > bK2 and c > dK,. In words, we would need to have a larger 
intrinsic growth rate of both species, or interaction terms with a smaller (in 
magnitude) coefficient, or a smaller carrying capacity of both species. 

Many variations and combinations of the predator-prey and competition 
models can be done and some of these extensions and related problems are 
explored in the Problems. 


478 Chapter 6. Geom Approaches and Apps of Systems of DEs 


/ bh NV 
A. 1\ 
\N {7 
VA 4 \ 4 
\\ \ | 
\ A \\ 
\ Ath \4 
\\ \\ 
\ A \\ 
vA VA 
NAN ate 
\ A \\ 
\ 05h eee ee aaa \ ps 
SX eo eoeneanenanaa Aw 
meh ee ea KN 
Ne 4 KN 
NAW 4 \ SN 
mn N74 ee ~N 
ey Oa ez 
(a) (b) 
\ yesh 
\\ Abe 
{ \ ra 
i! —/ 
Hi Sf 
A 414 NN 
A \ N 
‘4 \ i 
‘al NA 
\\ Na 
\\ Nay 
\ 5h Na 
\ A \A 
\ A NA 
NAW 4 2272772 NA 
NS ee SAN 
™~* —— 
Be Nae ag ase My 
(c) (d) 
FIGURE 6.22: Possible phase portraits for logistic competition model 


(6.65). We set b = d = Ky = 1, Ko = 1.2 for all the plots. (a) With 
a = 1.3, c = .9, only (41,0) is stable and the non-trivial equilibria is not 
biologically relevant. (b) With a = 1.1, c = .9, both (41,0) and (0, K2) are 
stable and the non-trivial point is biologically relevant but is a saddle. (c) 
With a = 1.1, c= 1.3, only (0, K2) is stable and the non-trivial point is again 
not biologically relevant. (d) With a = 2.1, c = 2.1, both (Ay,0) and (0, K2) 
are saddles and the non-trivial point is biologically relevant and stable. 

e e e e e e e e e e e e 


Problems 

In Problems 1-6, consider the given Lotka-Volterra models, with x,y > 0, 
and do the following: 

a) Give a possible interpretation of the equations based on the information 
in this section. 

b) Find the equilibria of this system. 

c) Use the Jacobian analysis to determine the stability of the equilibria. 

d) Find all bifurcations that occur in this system, if applicable. 

e) Use a computer program to generate a phase portrait for various initial 
conditions. 

f) Interpret the results in terms of the two variables and any parameters. 
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Tem ms aia ea 

y =y(2—y) —2y y =y(2—y) — ay 

3 gv =2(3-—2)—a2y 4 wv’ =3x—bry, b>0 

“(yl = —-2y + ry Ly! = 2y- ay 

5 wv =a(1—2)— xy 6 uv =a(b—«x)—2ay 

‘ly =y@-d), d>0 ‘ly =y-y)+ay, b>0 


7. In Example 1, we claimed that (6.63) could be rescaled to (6.64) with the 
substitutions « = Kv _ T=akt,a= = and 6 = Show this. 

In Problems 8-9, do (a)-(f) above for these two models of an arms race. 
Consider two economically competing nations which we call Purple and Green. 
Both nations desire peace and hope to avoid war, but they are not pacifistic. 
They will not go out of their way to launch aggression, but they will not 
sit idly by if their country is attacked. They believe in self-defense and will 
fight to protect their nation and their way of life. Both nations feel that 
the maintenance of a large army and the stockpiling of weapons are purely 
“defensive” gestures when they do it, but at least somewhat “offensive” when 
the other side does it. Since the two nations are in competition, there is an 
underlying sense of “mutual fear.” The more one nation arms, the more the 
other nation is spurred to arm. These models are known as the Richardson’s 
Arms Race model in honor of Lewis F. Richardson [42], who considered this 
model in 1939 for the combatants of World War I. 


8. Let x(t) and y(t) represent the yearly rates of armament expenditures of 
the two nations in some standardized monetary unit. We assume that 
each country adjusts the rate of increase or decrease of its armaments in 
response to the level of the other’s. The simplest assumption is that each 
nation’s rate is directly proportional to the expenditure of the other na- 
tion. We further assume that excessive armament expenditures present 
a drag on the nation’s economy so that the actual level of expenditure 
reduces the rate of change of the expenditure. The simplest way to model 
this is to assume that the rate of change for a nation is directly and nega- 
tively proportional to its own expenditure. We thus arrive at Richardson’s 
Model: 


d 
a = ay — mex (6.72) 
“ = ba —ny (6.73) 


where a, b, m, and n are positive constants. 


9. Consider (6.72)-(6.73) with the additional consideration of underlying 
grievances of each country toward the other. To model this, we introduce 
two additional constant terms, r and s, to the equations (6.72) and (6.73) 
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and obtain 
dx 
rT ay—ma+r (6.74) 
dy _ 
a bz — ny + 8. (6.75) 


A positive value of r or s indicates that there is a grievance of one country 
toward the other which causes an increase in the rate of arms expendi- 
tures. If r or s is negative, then there is an underlying feeling of good will, 
so there is a decrease in the rate of arms expenditures. For simplicity, 
assume that r,s have the same sign. 


Chapter 6 Review 


In Problems 1-6, determine whether the statement is true or false. If it is 
true, give reasons for your answer. If it is false, give a counterexample or 
other explanation of why it is false. 


1. 


2. 


6. 


Linearization of a nonlinear system about an equilibrium solution reduces 
it to a linear system in the neighborhood of this equilibrium solution. 
The phase plane can be drawn for any 2-dimensional autonomous system 
that can be written in the form x’ = Ax. 

For the 2-dimensional system x’ = f(t, x), we may have trajectories that 
cross in the x-y plane even if the Existence and Uniqueness Theorem is 
satisfied. 

The stability of an equilibrium point in 3+ dimensions can be determined 
by the signs of the trace and determinant of the Jacobian matrix. 


. For a Hopf bifurcation to occu, all we need to observe is the real part of 


a pair of eigenvalues switching sign. 
SIR models do not allow for births and deaths due to natural causes. 


For each of Problems 7-20, do the following parts: (i) consider the given 
matrix as the coefficient matrix A of the system x’ = Ax and use Theorem 
6.1.1 to determine the classification of the origin; (ii) use one of the computer 
programs to draw the vector field for each system x’ = Ax and some trajec- 
tories for various initial conditions. 
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5 —6 —-5 2 
[5-8] a0.[- 2 
For Problems 21-26, use Theorem 6.1.2 to classify the stability of the origin 
(the only equilibrium solution). 


wv’ =—lla+4y xv = 2a — l6y+6z 
21.¢ y' = 8a — 25y 22.¢ y! =—3a 4+ 4y — 32 
2 = —6x 4+ 12y —9z z' = —4x + 19y — 82 
x’ = 4x — 8y — 10z xv’ =—2Qy 
23.4 y’ =—-r+6y+5z 24.4 y =x+3y 
2’ =a —8y-—Tz zg =-—x-2ytz 
wv’ = —17x + 4y + 2z xv’ = 6x — l6y + 10z 
25.6 y' =5a—2By+z 26.4 y' =—5r+4y—5z 
2’ = 3a 4+ 12y— 122 z' = —8x + 19y — 12z 


For Problems 27-30, (i) find the equilibria of the given system; (ii) use lin- 
earization and Theorem 6.2.2 to classify the stability of the equilibria; (iii) 
use MATLAB, Maple, or Mathematica to draw the vector field of the system; 
(iv) sketch trajectories on the vector field for various initial conditions (either 
by hand or with the computer). You should verify that your answers from 
parts (iii) and (iv) agree with your predictions in parts (i) and (ii). 


gi =y?-1 wv =a+1 
eee ey 
xv’ =x(y-1) (oo 

29. 30. 
ay y=a-y 


For Problems 31-33, determine the type of bifurcation that occurs. Confirm 
your analytical results with qualitatively different phase portraits before and 
after the bifurcation. If instructed, draw the bifurcation diagram as well. 


vw =x2-9T xv’ =a(x—71) ee 
31. 32. 33. 
eee ee ae y=r-y 


34. Consider the SIS epidemic model with vital dynamics 
I 
S'= wN — BS= +al — pS 
I 
P= 68x — al — wl, (6.76) 


where S,J > 0, 8,a,4> 0 are parameters, and N= $+ I. 

(a) Give a biological interpretation of the model and an example of dis- 
eases that it might reasonably model. 

(b) Show that the population remains constant for all ¢. 

(c) Find all equilibria and classify their stability. 

(d) Find the basic reproductive number and interpret it. 

(e) Eliminate the S equation (because of the constant population) and 
solve I on the phase line. Do the results differ from the above analysis? 
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35. 


36. 


37. 
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Consider the SIS epidemic model with vital dynamics and constant influx 
of population 


I 
S'=A— BS + al — pS 
I’ = BS —al—wl, (6.77) 


where S,I > 0, 6,0, > 0 are parameters, A> 0, and N=S+T. 

a) By adding the equations together, describe the population level N* 
as t + oo. 

b) Consider the limiting system obtained by substituting N* from (a) 
into the system of equations and consider only the IJ equation. Why is 
this allowed? 

c) Determine the equilibria of the system and classify their stability. 

d) Find the basic reproductive number and interpret it. 


Consider the predator-prey model with an Allee effect in the prey (a) 


population: 
) 1 
Y= 2 ane (l—«)—ay 


y =y(a2-7r), (6.78) 


where x,y > 0 andr > 0 is a parameter. 
(a) Give a biological interpretation of the parameter r. 
(b) Find and classify the stability of the equilibria. 
(c) Give graphical evidence that a Hopf bifurcation occurs at r = 3. Is 
it subcritical or supercritical? 
Use MATLAB, Maple, or Mathematica to examine the Réssler system 
[48]. 

v= -y-2z 

y =x+ay 

z’ =b+2(a—- Cc). 
For a = b = .2,c = 2.5, determine the equilibria and their stability. Use 
the computer to draw the phase portrait. Describe what you see. Then 
repeat these steps for a = b = .2,c = 3.5. Again, describe what you see. 
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Chapter 6 Computer Lab: MATLAB 
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MATLAB Example 1: Enter the following code that demonstrates how to 
graph the vector field for the mass on a spring without friction using the values 
m = 2, k = 3. Thus we consider the second-order ODE 2x”(t) + 3a(t) = 0, 
which we must rewrite as the first-order system 


dx 
aa” 
dy —-3 


S> Gellgene pull 

SS (Dt, \dlameslagwesel(—22 5 32,—2e 532) 

> DxX=Y; 

>> DY=(-3/2) *x; 

>> DW=sqrt (DX. 2+DY.%2); %used to normalize vector lengths 
>> quiver(X,Y,DX./DW,DY./DW, .5); 

SS sdlelosil(s?))3 wileloail yw?) s 

SS ais ((—2 2 =2 ZI) 

>> title(’vector field for mass-spring system’) 


MATLAB Example 2: Enter the following code that draws the phase por- 
trait for the ODE system 


a’ =y—2x? 


y =y-@. 


This example may be supplemented/replaced with pplane, given at the end 
of this MATLAB computer lab. 


We first create the function ExamplePP.m which contains the equations: 


function f=ExamplePP (xn, yn) 

hh 

&%The original system is 

2x? (t)=y-x*2 and y’ (t)=y-x 

wWe let yn(1)=x, yn(2)=y, xn=t 

h 

f= [yn(2)-yn(1).%2; yn(2)-yn(1)]; 

Then create a script named Ch6MatlabEx2.m with the following code that 


uses ode45 or RK4.m to numerically solve the system for a given set of initial 
conditions. 


dbegin script 
t0=0; tf=10; 
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WEIS {ES}, 11]) 2 

[t,y]=RK4(@ExamplePP, [t0,tf],1C1,.05); 
G2 [Ee Oll: 
[t2,y2]=RK4(@ExamplePP, [t0,tf] ,IC2, .05); 
IC3=[-0.5,0.9]; 
[t3,y3]=RK4(@ExamplePP, [t0,tf] ,IC3, .05); 
UCAS,—, lls 
[t4,y4]=RK4(@ExamplePP, [t0,tf] ,1C4, .05); 
Ic5=[-0.15,0]; 
[t5,y5]=RK4(@ExamplePP, [t0,tf] ,IC5, .05); 
WEG= [2] 2 

[t6, y6]=RK4(@ExamplePP, [t0,tf] ,IC6, .05); 


% Now plot the numerical solutions we found above. 
MLOEGC . 1) ws .2)? 

axis([-4 3 -4 6]) 

hold on 

plow GAGs 1) .j2G DQ? 
plete 5D) WC .2)) 

plot (y4(:,1),y4(:,2)) 
DIGEGSC3 oi) WSC 2) 
MILOEG BCs 1) WSC .B)) 
[X,Y]=meshgrid(-4:.5:3,-4:.5:6); 
DX=Y-X./2; 

DY=Y-X; 

DW=sqrt (DX. 2+DY.”2) ; 

quiver (X,Y,DX./DW,DY./DW, .5); 
xlabel(’x’); ylabel(’y’); 
title(’phase plane example’) 
hold off 

end of script 


Save the file Ch6MatlabEx2.m and click the Run icon in MATLAB editor 
window. 


MATLAB Example 3: Enter the following code that calculates the equi- 
libria of 


and determines their stability. 


= 
a 
= 
Le 
= 
LE 
= 
= 
= 
= 


= 


= 


= 


= 


= 
= 
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clear all 

syms x y z fdefines the variables as symbolic 
f=[-6*x+6*y , 36*x-y-x*z,-3*ztx*y] “rhs of equations 
[x1,y1,z1]=solve(f) 

Z#Note that x1 has the 3 x-coordinates, yi has 

ithe 3 y-coords, and zi has the 3 z-coords 
equili=[x1(1,1), yi(1,1), z1(1,1)] %ist equil 
equil2=[x1(2,1), yi(2,1), z1(2,1)] 42nd equil 
equil3=[x1(3,1), y1(3,1), 21(3,1)] %3rd equil 
jaci=jacobian(f, [x,y,z]) 

#calculates jacobian 

Ji=subs(jaci,{x,y,z},equil1) %substitutes 

#ist equil into jacobian 

J2=subs(jaci,{x,y,z},equil2) %substitutes 

#2nd equil into jacobian 

J3=subs(jaci,{x,y,z},equil3) substitutes 

43rd equil into jacobian 

eigenvalsi=eig(J1) Z%computes eigenvalues for ist equil 
eigenvals2=eig(J2) %computes eigenvalues for 2nd equil 
eigenvals3=eig(J3) computes eigenvalues for 3rd equil 


MATLAB Example 4: Enter the following code that finds the \ = 0 bifur- 


cations of the SIR model with vital dynamics. To do so, consider the following 
two equations, where « = 2, i i, and recall that we only need to consider 
the first two equations since N is constant. We still have 6,7, u > 0. 


= 
= 
= 
= 
LE 
= 
LE 
= 
= 
CE 
= 
= 
= 
LE 
= 


a! = pp — Bay — par 
Oey ay (6.80) 


cleanealel: 

syms mu beta alpha x y xi yi lambda 

f=[mu-beta*x*y-mu*x; beta*x*y-(mutalpha)*y]%rhs of equations 
[x1,y1]=solve(f,x,y) 

equili=[x1(1,1),y1(1,1)] %DFE 

equil2=[x1(2,1),y1(2,1)] %EE 

J=jacobian(f,[x,y]) %calculates jacobian 
JO=subs(J, [x,y] ,equil1)%jacobian at DFE 
chpoly=charpoly(JO,lambda) /%characteristic polynomial at DFE 
chpoly0=subs(chpoly,lambda,0) %possible lambda=0 bifns 
params=[beta,mu, alpha] 

paramvalsi=[.4, .25, .2] 

eq3a=subs(chpoly0, params, paramvals1) 
eig(subs(JO,params,paramvals1) ) 
equil2a=subs (equil2, params, paramvals1) 
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>> eigenvals2a=eig(subs(J,[x,y,params] , lequil2a,paramvals1])) 
>> eval (eigenvals2a) 

>> paramvals2=[.5,.25, .2] 

>> eq4a=subs(chpoly0, params, paramvals2) 

> eig(subs(JO,params,paramvals2) ) 

>> equil2b=subs (equil2, params, paramvals2) 

>> eigenvals2b=eig(subs(J,[x,y,params] , lequil2b,paramvals2])) 
>> eval(eigenvals2b) 

>> simplify(subs(equil2,beta,mutalpha) ) 


Exercises for MATLAB are given after the following discussion of pplane. 


pplane in MATLAB 


For a system of only two equations, a very user-friendly software supplement 
called pplane exists for MATLAB and it is freely available for educational 
use. See <http://math.rice.edu/~dfield/>. There are two to three 
programs that you will need to download (depending on your version of 
MATLAB) and install in your working directory. pplane is much easier 
to implement than either of the above methods. It can also numerically 
find equilibria, determine stability of them, plot nullclines, and many other 
things. The drawback is that it only works for a system of two autonomous 
equations, whereas the above methods work for any number of equations. 
We give a brief introduction here. 

Once you have placed the relevant programs in your working directory, type 
pplane8. A new window should pop up; see Figure 6.23. (Note that this is 
for MATLAB R2013a. Download the appropriate files for other versions of 
MATLAB, e.g., pplane7 is for MATLAB 7.) 

We again consider the equations of the previous example and enter them 
in the pplane window as 


x? = y-x2 

y’ = yx 
In the display window, set minimum « = —4, maximum xz = 3, minimum 
y = —4, and maximum y = 6. 


In the direction field box, make sure arrows is marked. Click proceed and 
observe the direction field. Click once to trace a trajectory forward and back- 
ward in time. Repeat a few times. 

Now go to solutions —> find an equilibrium point. Then click with the 
mouse where you expect to see an equilibrium. Observe the Jacobian is given 
as are the corresponding eigenvalues and eigenvectors. (You can click display 
the linearization to see what happens near the fixed point.) 
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In the display window, graph t vs. x and t vs. y by going to graph —> both. 
Click on a trajectory that you want to see plotted. 

Now re-plot the picture but with lines, nullclines, and none checked (three 
separate plots). Experiment with number of field points per row or column to 
observe how this changes the display window. 


e020 pplane8 Setup 
File Edit Gallery Desktop Window Help x 


The differential equations. 


expressions 


The direction field. 


@) Arrows 


The display window. 


The minimum value of x = 
Number of 
Lines field points per 
row or column. 
Nuliclines 


The maximum value of x = 


The minimum value of y = 


@ ib) 2 ib 


The maximum value of y = None 20 


Quit Revert : ~ Proceed 


FIGURE 6.23: Pop-up window for pplane program used to obtain numer- 
ical solutions of two first-order equations. Note this was done with MATLAB 
R2013a and the corresponding program is pplane8. 


MATLAB Exercises 

Turn in both the commands that you enter for the exercises below as well as 
the output/figures. These should all be in one document. Please highlight or 
clearly indicate all requested answers. Some of the questions will require you 
to modify the above MATLAB code to answer them. 


1. Enter the commands given in MATLAB Example 1 and submit both your 
input and output. 

2. Enter the commands given in MATLAB Example 2 and submit both your 
input and output. 

3. Enter the commands given in MATLAB Example 3 and submit both your 
input and output. 
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A. 


10. 


11. 


12. 


13. 


14. 


15. 


16. 


. Plot the vector field for the first-order ODE system { 
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Enter the commands given in MATLAB Example 4 and submit both your 
input and output. 

xv’ = —5ax + 8y 

y! = —4x + Ty. 


Use pplane or modify the code from Examples 1 and 2 to draw phase 
: gv’ =-4r-y 
portrait for the ODE system \y ay 
Use pplane or modify the code from Examples 1 and 2 to draw phase 
: ae = ie = iy 
portrait for the ODE system ee Ee 
Use pplane or modify the code from Examples 1 and 2 to draw phase 
: vw’ = —4a + 2y 
portrait for the ODE system ee So, 
Use pplane or modify the code from Examples 1 and 2 to draw phase 
; ry 
portrait for the ODE system ti oes) 
Determine the equilibria and their stability analytically for the ODE sys- 
as 
tem / = i fe Then confirm your results with a phase portrait. 
Determine the equilibria and their stability analytically for the ODE sys- 
f= 
tem ee = i ee Then confirm your results with a phase portrait for 


the ODE system. 
Determine the equilibria and their stability analytically for the ODE sys- 


/ 


Cit! a 

y = 27 + 2y. 

the ODE system. 

Determine the equilibria and their stability analytically for the ODE sys- 
= 

tem ai i « =e Then confirm your results with a phase portrait for 

the ODE system. 


Determine the equilibria and their stability analytically for the ODE sys- 
f Sy? — il 

tem / oy a i: Then confirm your results with a phase portrait for 

the ODE system. 


Determine the 1 = 0 bifurcation that occurs for the ODE system 


tem Then confirm your results with a phase portrait for 


g =P =a, wee 
i i and the value of r at which it occurs. 


Determine the 1 = 0 bifurcation that occurs for the ODE system 
oe =H = De. 


a Se and the value of r at which it occurs. 
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17. Determine the ’ = 0 bifurcation that occurs for the ODE system 
ee pee 
a ~ '”~ “> and the value of r at which it occurs. 
yY =r Yy, 

18. Determine the ’ = 0 bifurcation that occurs for the ODE system 


ee ENS 3 
te ~ ' "+ and the value of r at which it occurs. 


Ge = Ss 
19. Determine the Hopf bifurcation that occurs for the ODE system 
ie 
une oe . and the value of r at which it occurs. 
OY = 250 se PU SP ae 


ie == a= Dy) : 
’ find all the biolog- 
y =y(2—z-y), e 


ically relevant equilibria and determine their stability. Then draw the 
phase portrait. 


20. For the Lotka-Volterra model 


21. Consider the Lotka-Volterra model { where x is 


a = a 
y' =y(z@—d), d>0 
the prey, y is the predator, and d > 0 is a parameter. Determine the 


A = 0 bifurcation that occurs. 
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Maple Example 1: Enter the following code that demonstrates how to 
graph the vector field for the mass on a spring without friction using the val- 
ues m = 2, k = 3. Thus we consider the second-order ODE 22” (t) +3a(t) = 0, 
which we must rewrite as the first-order system 


ae 
dp 2 
dy -3 
SCR ey Ba 81 
A 5 (6.81) 
restart 
with( DEtools) : 


eql := x(t) = y(t) 
eq2:= y(t) = a - a(t) 


DEplot ([eq1,eq2], [x(t), y(t)],t = 0..3, 2 = —2..2, y = —2..2, linecolor = black, 
dirgrid = [12,12], title = "vector field for mass-spring system", 
arrows = medium) 
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Maple Example 2: Enter the following code that draws the phase portrait 
for the ODE system 


restart 
with(plots) : with( DEtools) : 
eq! := 27(t) = y(t) — 2x 
eq2 = y(t) = y(t) — a(2) 
IC := [[x(0) = 3,y(0) = 1], [2(0) = -1, y(0) = 0}, [2(0) = — 5, 4(0) = 5}, 
f2(0) = 3, y(0) = 2], [2(0) = —-15, y(0) = 0}, [2(0) = —.15, y(0) =] 
DEplot([eq1,eq2|, |x(t), y(t)], t = 0..10, x = —4..3, y = —4..6, IC; stepsize = .05, 
title = "phase plane example", linecolor = black, method = classical|rk4]) 
phaseportrait([eq1,eq2], [%(t), y(t)], t = 0..10, IC, stepsize = .05, 
scene = |x(t), y(t)], tétle = "phase plane example", linecolor = black, 
method = classical|rk4]) 


Maple Example 3: Enter the following code that calculates the equilibria 
of 


x = —6x + by 
y = 362 —y — £z 
E = — 32 xy 


and determines their stability. 


restart 

with(LinearAlgebra) : with( VectorCalculus) : 
eqia:= —6-%+6-y 

eqib := 36-n—y-—2-z 
eqgic:=—3-z2+2-y 

eq? := solve({ eq1a,eq1b,eq1c}, {x, y, z}) 
eq2a := allvalues( eq2|2]) 

J := Jacobian([eqla,eq1b, eq1c], [x, y, 2]) 
eq3a := subs(eq2[1], J) 

eq3b := Eiigenvalues(eq3a) 

evalf(eq3b) 

eq4a := subs(eq2a1], J) 

eq4b := Eiigenvalues(eq4a) 

eqda := subs(eq2a2], J) 

eq5b := Eiigenvalues(eq5a) 
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Maple Example 4: Enter the following code that finds the \ = 0 bifurca- 
tions of the SIR model with vital dynamics. To do so, consider the following 
two equations, where « = 2, — d, and recall that we only need to consider 
the first two equations since N is constant. We still have 6,7, u > 0. 


a’ = pp — Bay — poe 
O) Or ihe ai in (6.82) 


restart 

with(LinearAlgebra) : with( VectorCalculus) : 

eqla:=u—P-G-y—p-xr 

eqib:=6-x-y—(ut+a)-y 

eq? := solve({eq1a,eq1b}, {x, y}) 

J := Jacobian([eq1a,eq10], |x, y]) 

JO := subs(eq2[1], J) 

chpoly := CharacteristicPolynomial( J0, X) = 0 

chpoly0 := subs(A = 0, chpoly) 

# The last equation is the condition when a “\ = 0” bifurcation may occur. 
This gives, as we know, the condition 8B = a+ ps (t.e., Ro =1). We now 
choose 2 sets of parameter values, for <0 and >0, and check stability. 

pannel = (o= Ajo = 25,0 = 2} 

eg3a := subs(params1, lhs( chpoly0)) 

equill := eg2{1| 

Figenvalues(subs(params1, J0)) 

equil2a := subs(params1, eq2[2]) 

Figenvalues(subs( equil2a,params1,.J)) 

joenunis? = b= 1,0 = 25,c0 = 2} 

eq4a := subs(params2, lhs(chpoly0)) 

Figenvalues(subs(params2, J0)) 

equil2b := subs(params2, eq2|2]) 

Figenvalues(subs( equil2b,params2, J)) 

subs(B = + a, eq2[2]) # The EE is the same as the DFE 

#end of code 


The last line shows us that the two equilibria are the same when 8 =a + wu. 
The lines from params1 until just before params2 show that for 8 < w+a, 
the DFE is stable whereas the EE is not biologically relevant and is unstable. 
The lines from params2 until the second to last one show that for 6 > w+a, 
the DFE is unstable whereas the EE is biologically relevant and is now stable. 
Taken together, we can conclude that a transcritical bifurcation occurred 
between the two equilibria. 


Maple Exercises 
Turn in both the commands that you enter for the exercises below as well as 
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the output/figures. These should all be in one document. Please highlight or 
clearly indicate all requested answers. Some of the questions will require you 
to modify the above Maple code to answer them. 


1. Enter the commands given in Maple Example 1 and submit both your 
input and output. 


2. Enter the commands given in Maple Example 2 and submit both your 
input and output. 


3. Enter the commands given in Maple Example 3 and submit both your 
input and output. 


4. Enter the commands given in Maple Example 4 and submit both your 
input and output. 

xv’ = —5ax + 8y 

y! = —4x + Ty. 

6. Modify the code from Examples 1 and 2 to draw phase portrait for the 


gv’ =—4de-—y 
ODE system ie 26665. 


5. Plot the vector field for the first-order ODE system { 


7. Modify the code from Examples 1 and 2 to draw phase portrait for the 


a! = ir = 9 
ODE system te oe 


8. Modify the code from Examples 1 and 2 to draw phase portrait for the 
wu’ = —4a + 2y 
y = —10r + 4y. 
9. Modify the code from Examples 1 and 2 to draw phase portrait for the 
[ee 

ODE system Ne - ee 
10. Determine the equilibria and their stability analytically for the ODE sys- 
a =y, 


tem ea ae Then confirm your results with a phase portrait. 


ODE system { 


11. Determine the equilibria and their stability analytically for the ODE sys- 
L = y, 
tem Ne aoe 
the ODE system. 


12. Determine the equilibria and their stability analytically for the ODE sys- 


‘= yY— 7, 
y = 27 +2y. 
the ODE system. 
13. Determine the equilibria and their stability analytically for the ODE sys- 
? 
tem ue iz « = Then confirm your results with a phase portrait for 
the ODE system. 


Then confirm your results with a phase portrait for 


tem Then confirm your results with a phase portrait for 
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14. Determine the equilibria and their stability analytically for the ODE sys- 
tem : 7 f - Then confirm your results with a phase portrait for 
the ODE system. . 

15. Determine the A = 0 bifurcation that occurs for the ODE system 


oe 
i * and the value of r at which it occurs. 


Up 
16. Determine the ’ = 0 bifurcation that occurs for the ODE system 
e = — De, 


ee and the value of r at which it occurs. 


17. Determine the ’ = 0 bifurcation that occurs for the ODE system 


y =x—y, 
18. Determine the ’ = 0 bifurcation that occurs for the ODE system 


ORES 
{ v= Te 2's and the value of r at which it occurs. 


Nae: 
Nee ~~ "> and the value of r at which it occurs. 


Yo = —Y 
19. Determine the Hopf bifurcation that occurs for the ODE system 
gv =rz + 2y, ee 
ee = 29 + ry + 22y, and the value of r at which it occurs. 


xv’ = 2(3 — 2 — 2y), 
y =y2—ax—y), 
ically relevant equilibria and determine their stability. Then draw the 
phase portrait. 


20. For the Lotka-Volterra model { find all the biolog- 


= — — 
21. Consider the Lotka-Volterra model ee ee where is 


y' =y(z@—d), d>0 
the prey, y is the predator, and d > 0 is a parameter. Determine the 
A = 0 bifurcation that occurs. 
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Mathematica Example 1: Enter the following code that demonstrates how 
to graph the vector field for the mass on a spring without friction using the 
values m = 2, k = 3. Thus we consider the second-order ODE 22”"(t)+32z(t) = 
0, which we must rewrite as the first-order system 

dx 

GT y 

dy -3 


== (6.83) 
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Quit| | 


3 
vectorriot|{y.-—"h, te, =By Dey Ayn =Bo Bh. 


VectorScale—+{Small, Small, None}, Axes—-Automatic, 
AxesLabel>{"x", "y"}, VectorPoints—+10| 


Mathematica Example 2: Enter the following code that draws the phase 
portrait for the ODE system 


eg =y— 2 
y =y-Z. 
Quit| | 
dex[t_] = y[t] - x[t]? 
dey[t_] = y[t] - x[t] 


ICx={x [0] ==3,x[0]==-1,x[0]==-.5,x[0]==3,x[0]==-.15,x[0]==-.8} 

Icy={y [0] ==1, y [0]==0, y[0]==.5, y [0] ==2, y [0] ==0, y [0] ==0} 

solni=NDSolve[{x’ [t]==dex[t],ICx[[1]], y’ [t]==dey[t] ,Icy[[1]]}, 
{x, y}, {t, 0, 3}, StartingStepSize—.05, 

Method—{FixedStep, Method—ExplicitRungeKutta}] 

soln2 = NDSolve[{x’ [t]==dex[t], ICx[[2]], y’ [t]==dey[t], 

Icy([2]]}, {x, y}, {t, -1, 1}, StartingStepSize—.05, 

Method—{FixedStep, Method—ExplicitRungeKutta}] 

soln3 = NDSolve[{x’ [t]==dex[t], ICx[[3]], y’ [t]==dey[t], 

Icy([{3]]}, {x, y}, {t, -1, 10}, StartingStepSize—.05, 

Method—{FixedStep, Method—ExplicitRungeKutta}] 

soln4 = NDSolve[{x’ [t]==dex[t], ICx[[4]], y’ [t]==dey[t], 

Icy([4]]}, {x, y}, {t, 0, 10}, StartingStepSize—.05, 

Method—{FixedStep, Method—ExplicitRungeKutta}] 

soln5 = NDSolve[{x’ [t]==dex[t], ICx[[5]], y’ [t]==dey[t], 

Icy({5]]}, {x, y}, {t, -1, 8}, StartingStepSize—.05, 

Method—{FixedStep, Method—ExplicitRungeKutta}] 

pi = ParametricPlot[{Evaluate[{x[t], y[t]}/.soln1], 
Evaluate[{x[t], y[t]}/.soln2], Evaluate[{x[t], y[t]}/.soln3], 
Evaluate[{x[t], y[t]}/.soln4], Evaluate[{x[t], y[t]}/.soln5]}, 
{t, 0, 7.5},PlotStyle—{Thickness[0.015]}, 
PlotRange>{{-3, 4}, {-3, 5}}]; 

p2 = VectorPlot[{y - x*, y - x}, {x, -3, 3}, {y, -3, 5}, 
VectorScale—+{Small, Small, None}, Axes—Automatic, 
AxesLabel>{"x", "y"}, VectorPoints— 10]; 

Show[p1, p2, PlotLabel—>+"Phase plane plot"] 

fx = Function[{x, y}, y - x7]; 

fy = Functionl[{x, y}, y - x]; 
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Mathematica Example 3: Enter the following code that calculates the 


equilibria of 


i = He sp Oy) 
y = 362 — y — £z 


2 =—32+ ry 


and determines their stability. 
Quit|] 

eqix = -6x + 6y 

eeily = Sox — 7 — mez 

Geils, = “8x4 a oy 


eq2 = Solve[eqix==0 && eqly==0 && eqiz==0, {x, y, z}] 
(*sometimes FullSimplify helps at this step*) 


(J = D[{eqix,eqly,eqiz}, {{x,y,z}}])//MatrixForm (*Jacobian*) 


(*Note the extra parenthesis before //MatrixForm *) 
(*This allows calculations to be done on J*) 


(J1 = J/.eq2[(1]])//MatrixForm 
eigi = FullSimplify [Eigenvalues [J1]] 
Nleig1] 
(J2 = J/.eq2[[2]])//MatrixForm 
eig2 = FullSimplify [Eigenvalues [J2]] 
N[eig2] 
(J3 = J/.eq2[[3]])//MatrixForm 
eig3 = FullSimplify [Eigenvalues [J3]] 


Mathematica Example 4: Enter the following code that finds the \ = 0 
bifurcations of the SIR model with vital dynamics. To do so, consider the 
following two equations, where 7 = 5, — d, and recall that we only need to 
consider the first two equations since N is constant. We still have 6,7, w > 0. 


a =p — Pry — px 
y’ = Bay — (w+ )y.- 


Quit|] 

eqia = wp - Pxy - px 

eqib = Bxy - (ut+ay 

eq2 = Solve[{eqia==0, eqib==0}, {x, y}] 

(J = Di{eqia, eqib}, {{x, y}}])//MatrixForm 
(JO = J/.eq2[[1]])//MatrixForm 

chpoly = CharacteristicPolynomial[JO, \] 


(6.84) 
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chpolyO = ReplaceAll[chpoly==0, A-—0] 

(*The last equation is the condition when a "A=0" 
bifurcation may occur. This gives, as we know, the condition 
beta= alpha + mu (i.e., RO = 1). We now choose 2 sets of 
parameter values, for < 0 and > 0, and check stability. *) 

paramsi = {6—>.4, u>.25, a.2} 

First[chpoly0] (*left-hand-side*) 

Last[chpoly0] (*right-hand-side*) 

eq3a = ReplaceAll[First[chpoly0], params1] 

equili = eq2[[1]] 

ReplaceAll[Eigenvalues[JO], params] 

equil2a = ReplaceAll[eq2[[2]], params1] 

Eigenvalues [ReplaceAll[ReplaceAl1[J, paramsi], equil2a]] 
params2 = {6—.5, u—.25, a.2} 

eq4a = ReplaceAll[First[chpoly0], params2] 

Eigenvalues [ReplaceAl1[JO, params2]] 

equil2b = ReplaceAll[eq2[[2]], params2] 

Eigenvalues [ReplaceAll[ReplaceAl1[J, params2], equil2b]] 
Simplify [ReplaceAll[eq2[[2]],S—-y + al] 

(*The EE is the same as the DFE*) 

(*end of the code*) 


The last line shows us that the two equilibria are the same when 6 = a+ wu. 
The lines from params1 until just before params2 show that for B < w+a, 
the DFE is stable whereas the EE is not biologically relevant and is unstable. 
The lines from params2 until the second to last one show that for 6 > w+a, 
the DFE is unstable whereas the EE is biologically relevant and is now stable. 
Taken together, we can conclude that a transcritical bifurcation occurred 
between the two equilibria. 


Mathematica Exercises 
Turn in both the commands that you enter for the exercises below as well as 
the output/figures. These should all be in one document. Please highlight or 
clearly indicate all requested answers. Some of the questions will require you 
to modify the above Mathematica code to answer them. 
1. Enter the commands given in Mathematica Example 1 and submit both 
your input and output. 
2. Enter the commands given in Mathematica Example 2 and submit both 
your input and output. 
3. Enter the commands given in Mathematica Example 3 and submit both 
your input and output. 
4. Enter the commands given in Mathematica Example 4 and submit both 
your input and output. 


10. 


ili, 


WE 


13. 


14. 


15. 


16. 


Wie 


. Plot the vector field for the first-order ODE system { 
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xv’ =—5x+8y 

y’ = —Ax + Ty. 

se pplane or modify the code from Examples 1 and 2 to draw phase 

i =p Wj 

y’ =6a+y. 

se pplane or modify the code from Examples 1 and 2 to draw phase 

f= hey 

y =3rt+y. 

se pplane or modify the code from Examples 1 and 2 to draw phase 
; CA 

ortrait for the ODE system He Pipe edn 

se pplane or modify the code from Examples 1 and 2 to draw phase 

x’ = —Tax — 4y 

y’ = 10x + 5y. 

Determine the equilibria and their stability analytically for the ODE sys- 


ie 
tem { a Se g Then confirm your results with a phase portrait. 


ortrait for the ODE system { 


ortrait for the ODE system { 


eG te et Se eS sh ie 


portrait for the ODE system { 


Gy =a, 
Determine the equilibria and their stability analytically for the ODE sys- 
aw =y, 

y =4— a2. 
the ODE system. 
Determine the equilibria and their stability analytically for the ODE sys- 


im = y= a, 

yi = x? + Qy. 

the ODE system. 

Determine the equilibria and their stability analytically for the ODE sys- 

ie 

tem / _ 4 = Then confirm your results with a phase portrait for 

the ODE system. 

Determine the equilibria and their stability analytically for the ODE sys- 
ee ee 

2; = os : Then confirm your results with a phase portrait for 

yl =a —y. 

the ODE system. 


Determine the ’ = O bifurcation that occurs for the ODE system 


g =p, oe 
Fane and the value of r at which it occurs. 


Determine the \ = O bifurcation that occurs for the ODE system 


tem Then confirm your results with a phase portrait for 


tem Then confirm your results with a phase portrait for 


tem 


/ 

=7— So 

{ i. y o and the value of r at which it occurs. 
Uf = Psp a= = Os 


Determine the ’ = O bifurcation that occurs for the ODE system 
is! — Tp) ne, 


fi and the value of r at which it occurs. 
nD 
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18. Determine the ’ = O bifurcation that occurs for the ODE system 


pee aes 
te ~~ ""+ and the value of r at which it occurs. 


Go = Us 
19. Determine the Hopf bifurcation that occurs for the ODE system 
i 
pakLe 1, 2 and the value of r at which it occurs. 
y =—2e+ry +x y, 


xe’ = 2(3 — 2 — 2y) : 
’ find all the biolog- 
y’ =y(2—2-y), P 


ically relevant equilibria and determine their stability. Then draw the 
phase portrait. 


20. For the Lotka-Volterra model 


: Lae ; 
21. Consider the Lotka-Volterra model ee Seed. ast where 2 is 


the prey, y is the predator, and d > 0 is a parameter. Determine the 
A = 0 bifurcation that occurs. 
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Project 6A: An MSEIR Model [21] 

Consider a model for a disease for which infection confers permanent 
immunity (e.g., measles, rubella, mumps, and chicken pox) and for which 
a mother’s immunity gives her newborn infant passive immunity from the 
disease; that is, some of the mother’s antibodies will protect the newborn 
from the disease for, say, the first six months of her/his life. Verify that 
Figure 6.24 gives rise to the following system of differential equations: 


dM 
Ties b(N — S)— eM — pM 
ds 
= t eM 
oF bS + € Box ES 
dE I 
= BS) OE E 
i if 
dl 
= d6Bh-—47I- pl 
dt Y LM 
dR 
=i — pR 6.85 
qe VE BR, (6.85) 
where N=M+S+E+I/+4 Ris the total population. 
Show that aN 
—=(b-—p)N 
qe (OO BN, 


where N = M+ $4 E+4+I/+4+4R is the total population. Is the total 
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population constant or oe oe the differential equation in 
its fractional form (with m e zi ir z) and 
eliminate s from the system to nae 


S, 


d 

a= ut ale+itr)—em 

de ; : 

qe EU m—e-—i-r)ji-(6+pu+q)e 

di 

po 

dr , 

7a koee (OL (6.86) 


where q = b — ys is the difference between the birth and death rates. 
Show that 
{(m,e,7,r)|0 <m,0<¢,0<i,0<r,m+e+it+tr<1} 


is a positively invariant domain. Determine conditions on the stability 
of the DFE and show that the basic reproductive number is given by 


BO 
(ytut+a(d+uta) 


Interpret the meaning of Ro in terms of the parameters of the system. 
Try to find the unique endemic equilibrium of the system that lies in 
the invariant region. Determine its stability and when it is biologically 
relevant. For chicken pox, 1/e = 6 months, 1/6 = 14 days, and 1/y = 7 
days; choose reasonable values for the birth and death rates in (6.86). 
Choose two different (-values that will give qualitatively different 
behavior in the system (only the DFE and then another that gives both 
an EE and a DFE). Give plots for these two different situations similar 
to that of Figure 6.18. 


Ro = 


FIGURE 6.24: Flowchart for MSEIR model with exponentially changing 
size. 
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Project 6B: Routh-Hurwitz Criteria 
In this project we explore an alternative way to examine whether Re(\) < 
0 for all A;. Although this project may be done by hand, it may help 
in easing some of the computation to have MATLAB, Maple, or Math- 
ematica available. In the context of this chapter, this will allow us to 
determine the conditions for the local asymptotic stability of an equilib- 
rium point via the Routh-Hurwitz critera. These criteria give conditions 
that guarantee the local asymptotic stability of the linearized system at 
zero. The conditions are on the coefficients of its characteristic polyno- 
mial. The Routh-Hurwitz criteria is the standard tool for cases where 
the eigenvalues are difficult to compute explicitly [16]. “Difficult to com- 
pute explicitly” usually means bigger than a 2 x 2 matrix. Especially 
for epidemiological models, this critera will help us determine stability 
of the point. 

For the Routh-Hurwitz criteria, consider the nth-order system which 
has been linearized at an equilibrium ux, which without loss of generality 
is assumed to be zero. Hence, the linearization is given by the system 


du 
— = Au 

dt 
where u € R” and A is an n x n matrix (Jacobian of u* = 0). The 
characteristic polynomial of this system can be written as 


pd) = A" apd” 1 aa A\” +... + aa, 


where a; € R for 1 = 1,...,n. Without loss of generality, we can assume 
that a, 4 0 otherwise p(A) has a zero root, i.e., A = 0 is a solution, and 
the problem reduces to finding the non-zero roots of an (n — 1)st degree 
polynomial with a,_; # 0 and so on. In order for u* to be stable we 
need Re(A;) < 0 for all i = 1,...,n. These conditions are derived from 
the determinants of the principal minors, A;, 7 = 1,..,n, of the Hurwitz 
matrix (see, e.g., [16]), 


oy | 0 © O © Mee. 
a3 a2 a, 1 © © Wess 
H,, — | @5 %4 43 a2 a1 UNIO) ies 
Q7 06 45 G4 a4 ag 1... 


where the (i, j)th entry is 
a2i—5 for O02, =i S Ws 
a LOG 
0 koe <P MHS seg. 
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(Notice the main diagonal has the a; and observe the contents of each 
row based on this.) 


Routh-Hurwitz Criteria [30]: 
For the polynomial p(X) to have only roots with negative real parts, it is 


necessary and sufficient that A; > 0, fori =1,...,n, where 
all ay i @ 
1 
Ne = Gis Da = a. a ’ A3 = a3 a2 a, 200 AN, = CpAyp—ile 
iG a5 a4 43 


A Simple Example: Consider the characteristic polynomial p(A) = 
3+ A? +X+1. Then 


ay il 0 Tl 0) 
Az = a3 ag aj, = it i i Ay ily Ao 0, A3 0, 
Ny 0) cbs Caro 


which shows that p(A) is unstable. We could have stopped at Ag = 0 
because one violation of A; > 0 is enough. 


More Realistic Example: van der Pol Oscillators Coupled via a Bath 
Consider the system [12] given by 


x" (t) — e(1 — 2(t)*)a"(t) + a(t) = (24) — 2(2)), 
y(t) — (1 — y(t)”)y'(t) + yt) = (2 ) 
2'(t) = y(x(t) — 2(¢)) + vy) - 


where y and € are nonnegative. The origin is an equilibrium point and 
we will determine its stability based on a relation of the parameters 7y-e. 
(1) Calculate the Jacobain about the origin and show that the charac- 
teristic polynomial is 


p(d) = A° + (—2e + Qy)A* + (€2 +2 + 2y — 4ey)A3 
+(2e74 + 297 — 2e — Qey +49)" (6.87) 
+(1 + A? — ey? + 2y — 4ey)A + 27(1 +). 


(3) Verify the Hurwitz matrix for (6.87) is 


oy I © © 0 
a3 a2 a1 am) 
H; = | 45 a4 Q3 A202 a1 | , (6.88) 
0 0 as a4 ag 
0 0 0 0 as 
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and show that the A;,i = 1,2,3,4,5 for our system are 


A, = 2(y7- ©), No = (2 = 8e)97 + (—2e + 877 = 26° = 2e, 
A3 = —8ey* + (4 — 16 + 20c? — 16e°) 7? 

ae (Ge: Ae le ibe \y aie eee ey ete 
Ag = 4e(2e?y — € — ey — 4ey” + 277) 

(a? +e y — 9679? — Bey? = Beye 4 ey 4 ey? — 4"), 
As = 8y(1 + y)e(2e74 — € — ey — Aey? + 297") 


(ey? + 2e8y — De? 4? — e7y? — 2e7y — c* + Dey? + Qey? — 74). 


(5) By applying the Routh-Hurwitz criteria to expressions for Ag and Ag, 
we now determine the stability of the origin in the entire first quadrant 
of the (7, €) plane. 

(a) Consider the curve(s) that separate the A; > 0 region, for i = 2,4. 
Obtain an analytic expression for these curves by considering the solution 
set of each expression. Solve Az = 0 to obtain the curve C; given by 

Bo 2(-4y?+3y4+3)  4y 
Gis ¢€= 
6 3B 3 


(6.89) 


where 


al 
B = (647° + 369? + 144y + 12/9675 + 15374 — 1273 + 1327? + 36y 4 12). 


(b) Solve A, = 0 to obtain the curve C2 given by 


= tl vie 8y3 + 972 +27 +1 


C2: 
2 Ts 


(6.90) 

(c) Conclude that above the curve C, in the first quadrant of the 
(y,€) plane, Ap < 0. The curve C lies between the line « = 0 and the 
curve C2. Below the C2 curve, A, < 0. Thus for « > 0 and y > 0 there 
is always a negative A; for some 7 and by the Routh-Hurwitz criteria 
the origin is always an unstable equilibrium point in the original system. 


The interested reader should attempt to apply this criteria to some 3x3 
(or larger!) systems that are known to have complicated eigenvalues for 
additional practice with this method. 
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Laplace Transforms 


7.1 Introduction 


Consider the first-order electric circuit with an inductor and resistor only 
shown in Figure 7.1 with the switch in closed position (including Vo in the 
circuit) and in open position (so that Vo is not part of the circuit). Suppose 
that the switch begins in the closed position so that constant voltage Vo is 
applied for 0 < t < 1, then a step down in voltage from Vo to 0 occurs at t = 0 
as the switch is opened, and thus a constant applied voltage 0 is applied for 


t>1: 
= Vo, O<t<1 


0 t>1 (7.1) 


bi +RI={ 


where J is the current in the circuit, LD measures the inductance, and R mea- 
sures the resistance, and Vo is the constant applied voltage. 


Switch L Switch L 


; F @ul N3 


(a) (b) 
FIGURE 7.1: (a) RE circuit with switch is in the closed position so that 
Vo is included in the circuit. (b) RL circuit with the switch is in the open 
position so that Vo does not contribute. 


We previously considered this equation for a continuous forcing function, but 
now our forcing function is a piecewise continuous function. We can 
separate this into two problems, each of whose solution we can easily find: 


O<t<1: LV +RI=H=1= B+e™ (1(0)- ¥) 


t 
t>1: LI'+ RI =0 =} I= 1 (1*)er, 


The initial condition J(1*) in the t > 1 solution can be found examining 
lim I(t) in the first solution. Since that solution is continuous, we can plug 
t>1- 
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Input Voltage 


ni 
° 


(a) * (D) 3 = 
FIGURE 7.2: (a) Plot of input forcing function with Vo = 3 in (7.1). (b) 
Solution to (7.1) with Vo = 3, R= 1, L = 1, I(0) = 1.5. The blue solution is 
for 0 < t < 1 while the black solution is for t > 1. 


in t= 1 and rewrite the general solution as 


Yo + eZ (1(0) — 8), Ga7e1 
n= [¥2 +e (I(0) — 2) ] er), 451. i 
Figure 7.2 shows the plot of the solution on [0, 4]. 
This type of problem seemed simple enough in its set-up but the jump at 
t = 1 resulted in our solving two IVPs and then rewriting one of the initial 
conditions in terms of the original solution. As we will see in the ensuing 
sections, Laplace transforms will be a way to avoid solving this problem twice 
by first transforming the problem from the time domain to the frequency do- 
main and solving a much simpler problem before transforming back to the 
time domain. While in the frequency domain we will additionally be able to 
observe the long-term behavior of the solutions with minimal effort. But first 
we will need to develop some of the mathematical machinery that will be used 
in our study. 


Unit Step Function 

The forcing function of our motivational equation (7.1) is a piecewise contin- 
uous function. It is a bit special, however, in that it is constant where it is 
continuous. 


Definition 7.1.1 

A function f is said to be piecewise continuous on a finite interval a < 
t < 6 if this interval can be divided into a finite number of subintervals 
such that 

1. f is continuous in the interior of each of these subintervals. 

2. f(t) approaches a limit (finite) as t approaches either endpoint of the 
subintervals from its interior. 


More specifically, if f is piecewise continuous on a < t < b and ¢g is an 
endpoint of one of the subintervals, then the right- and left-hand limit exists, 
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that is, 


{G; y= lem FO) and. FG; )= lim, f(t) are finite and exist. 


toto toto 


| Example 1: | Consider the function f defined by 


-1, 0<t<2 
iL. E> 2. 


Solution 
The function f is piecewise continuous, for at t = 2 we have 


f(27) = limi 42- f(t) =—-1 
f(2" )-= lim40% f(t) = 1, 


We now consider a very special piecewise continuous function, called the 
unit step function 
0, %t<O 
1, t>0, 


Up(t) = { 


which is also referred to as a Heaviside function. We note that for some 
applications it is convenient to define Up(0) = 5, which is the average of 
Uo(0~) and Up(0*). However, in calculating Laplace transforms, we will see 
that the value of the function at the point of discontinuity is not relevant 
but rather it is the values to the left and right of this discontinuity. We 
thus don’t include a value of the function at the discontinuity in order to 
stress this point and we will view the function as instantaneously changing its 
values at the point of discontinuity. The subscript represents the location of 
the discontinuity and we can horizontally translate this curve to define the 
shifted unit step function. For each real number a > 0, we have 


0, t<a 
v= 44 t>a. 


We can think of this as a fundamental building block for piecewise continuous 
functions. We will often refer to both Uo(t) and U,(t) as unit step functions. 
Using our previous notation, we can again talk about the limits to the left 
and right of t = a for our unit step function and write 


Ua )= lia =0 ond Ujfe")=— lim = 1, (7.3) 


toa troat 


| Example 2:| Graph the unit step function Up(t) and 


b,t<2 
ees (7.4) 
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TRG) | 
5(1-U,() 


FIGURE 7.3: Graphs of Uo(t) and (7.4). 


Then rewrite (7.4) using U,(t). 


Solution 
We can graph both functions as shown in Figure 7.3. 


We see two differences: there are each zero on different sides of the discon- 
tinuity and the non-zero portion is not one. For the first part, we observe 


that 
1, t<2 


1— watt) = { 9) t>2. 


Multiplying by 5 will thus give us our desired result: 


5, t<2 
51-02) = {5 iso. 


| Example 3:| Rewrite the box function 


0, O<t<2 
f)=4 3, 2<t<5 
0, %t¢>5 


using shifted unit step functions. 


Solution 


This is just the linear combination 3U2(t) — 3Us(t), that is, 


0, t<2 0, €<5 
Balt) ~ 305() = {3 t>2 . z>5 
0, O<t<2 
=¢3, 2<t<5 
0, t>5. 
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Unit Impulse Function 

Considering what happens in electrical and mechanical systems when sub- 
jected to an impulse (a large but finite input over a very short time period) is 
often a problem of great interest. Suppose we consider the following problem. 


9S Consider the first-order electric circuit with capacitor and re- 
sistor. Figure 7.4(a) shows the switch in the open position (where V, does not 
contribute) and Figure 7.4(b) shows the switch in the closed position (where 
V, is now included in the circuit). At time t = 0, the switch is moved from 
the closed to the open position so that only R and C are in the circuit and 
there remains an initial charge Q(0) in the circuit. However, suppose that a 
voltage spike, V,, is applied and lasts from t = 1 to t = 1.1, represented by 
the quick closing and then re-opening of the switch. Find the voltage for any 
time t > 0. 


Switch Switch 


Ae GN 


FIGURE 7.4: RC circuit of — 7 recall that [ = ae (a) The switch 
is in the open position so that V; does not contribute. (b) The switch is in 
the closed position so that V, is now included in the circuit. 


Solution 
The autonomous part of the differential equation is that of an RC circuit and 
the forcing is due to the voltage spike: 


Q 0, 0<t<l 
RQ’ + a7 Vs Loreal (75) 
0, lil<t 


where R measures the resistance, C measures the capacitance, Q is the charge 
on the capacitor, and V, is the voltage spike. This involves solving three 
differential equations and we could rewrite the forcing as a combination of 
step functions: 
0, 0<t<l 
V.(U, — U1.1) = V3, L<e< ia 
0, Lt 
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For comparison in a later section, the solution can be written as 


t 


O<t<1: RQ’+$=0 + Q=Q(O)erc 
1<t<ll: RY'+8=V.5Q= eral Coane Q(0)) (7.6 
t> 1.1: RQ’'+2= 0>Q=eRo (V.C + Q(0)e* =VC a) 


as you will show in Problem 12, and where we again note that we will not 
define the function at the point of discontinuity. We can plot this solution for 
specific values as can be seen in Figure 7.5. 


(a) a (b) 
FIGURE 7.5: (a) The input voltage into the RC circuit: a voltage spike 
with V, = 50 for t in (1,1.1) and 0 otherwise. (b) Solution to (7.5) with 
Q(0) =3, R=2,C=1, V, = 50. 


In Example 4, the voltage spike was a tall and narrow box function. For 
the differential equation P(D)« = f(t), we consider the impulse of the force 
f(t) that is centered at to as the area under the curve of the spike: 


= / * f(t) dt. (7.7) 


In our Example 4, this area was 50 x 0.1 = 5 (ignoring units). Mathematically, 
we might wonder how much difference our solution would be if the voltage 
spike lasted from t = 1 to 1.05 or even 1.01 instead. To do so, consider the 
specific box function: 


1 


f(t) = Dy (Ut, —a(#) a Vip t+a(t)) 


1 

—, for to- t<t 

- or to-a<t<tt+a (7.8) 
0, otherwise 
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with a a constant. For the f given in (7.8), we can calculate this area as 


tota 
m= f f(t) dt 


Oe 


=f soa 
= (7.9) 


where we were able to extend the integral over all t-values because f = 0 
outside of [—a,a]. We are most interested in what happens for small a and 
we thus define 


6(t — to) ~ (Ui,-alt) — Uieralt)) (7.10) 


= li — 
har 2a 
The function 6(t — to) is called an idealized unit impulse function. It is 
widely used in physics as well where it goes by another name: the Dirac delta 
function. We have thus constructed a rather interesting function, properly 
called a generalized function, that we now formalize with a definition. 


Definition 7.1.2 


The (idealized) unit impulse function 6 is the function that satisfies 


0, for t oe to 


CO, or t= tm i) 


sto) = { 


and 


[oe toyae=1. (7.12) 


Using some of our previous notation to denote what happens to the left and 
to the right of to, we can also write (7.11) as 


6(0-)=0, 6(0*T)=0, 65(0) =o. (7.13) 


We motivated the unit impulse function in Example 4 as a brief (in time) 
force and found the explicit solution. We will see in the ensuing sections that 
Laplace transforms will allow us to solve differential equations “quickly” with 
step functions, box functions, or impulse functions and we will come back and 
compare the idealized impulse with the finite impulse of Example 3. Before 
moving on, however, we will state a few useful theorems involving the Dirac 
delta function. 
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THEOREM 7.1.1 


Suppose that g(t) is a bounded continuous function. Then 


[ste -toald) dt = alto. 


One final result shows a relation between the unit step function (Heaviside 
function) and the idealized unit impulse function (Dirac delta function). 


Consider the unit step function 


@O v<o 
vol) = 43 t>0 


and the idealized unit impulse function centered at the origin: 


a) = os aia with f o(t)ae=1. 


Ch, use e= 0" 


Then d 
qo (t)] = 6(). (7.14) 


Remark: We stated that we refer to 6(t) as a generalized function and 
thus we often refer to the above notation as a generalized derivative. 


Recall that we have chosen Up(0) as undefined. In this case or if we had 
defined Up (0) = 3 we could use the typical definition of the derivative. How- 
ever, we instead choose to introduce the equivalent centered difference for 
the derivative of f(x): 


(7.15) 


Although the relation between the Heaviside and Dirac delta function may 
seem a bit strange, we apply the definition of the derivative to Up(t) for t 4 0: 


Uo(t +h) — Up(t — h) 


—[Up(t)] = 1 
qo = 2h 
a lm0=0, t<0 
—_ jroo 2h h>0 2h = h-0 
= : (7.16) 
oe 1 ee 


and observe that this matches exactly with d(¢) = 0 for t € 0. For the 
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derivative when t = 0, we have 


d — ix. Mole) — Uo(=—n) 
ra) = jim a ae 
0-1 . —l 
lim —— = lim —  =oo 
= ih 1 A eg ri (7.17) 
ie aoe 


This matches the definition for the Dirac delta function at 0: 6(0) = co. This 
will come up when we are applying the Laplace transform to the unit step 
function. 


Brief Overview 


In the remainder of this chapter we will develop properties of the Laplace 
transform, which will be very useful in certain applications. While we con- 
sidered first-order circuit equations in the examples of this section, we could 
also consider the equation 
a dx 
mia toe +ka = F(t) 

for the position x(t) of a mass on a spring. We saw in Chapter 4 this mass- 
spring system and considered some of its applications. In all of the problems 
we considered previously, the forcing function F(t) was continuous. In many 
practical applications, however, F(t) may have discontinuities. For instance, 
the mass may be periodically struck, imparting a force F(t) at time t. In this 
case, the methods we used in Chapter 4 are awkward and the solutions may 
be cumbersome. It is just these kinds of applications for which the Laplace 
transform is useful. 

The Laplace transform will be formally defined in the next section, but to 
set the stage and motivate what is about to come, we will let £ represent 
the Laplace transform. We will see shortly that the Laplace transform of a 
function f(t) produces a function F'(s), that is, 


F(s) = L{f(t)} 


where F is a function of a new independent variable s. 

After learning some of the basics of computing Laplace transforms of some 
basic functions, we will see that the Laplace transform converts a differential 
equation P(D)x = f(t) with its initial conditions into an algebraic equation 
in Y(s) = L{a(t)}. It is often the case that such an algebraic equation is 
easier to solve than the differential equation. We will develop a method of 
converting from the solution of the algebraic equation to the solution of the 
differential equation; the original variable x(t) is obtained from the inverse 
Laplace transform x(t) = £~'{Y(s)}. The ideas discussed here are schemat- 
ically shown in the following diagram. 


bie Chapter 7. Laplace Transforms 


Laplace Transform 


Y 


Initial-Value Problem Algebraic Equation 


Difficult Easy 
v Y 
Solution of . Inverse Solution of 
Initial-Value Problem Algebraic Equation 
Laplace Transform 


e e e e e e e e e e e e 
Problems 
In Problem 1-11, write the given piecewise continuous functions using shifted 
unit step functions. 
1. f= f2, 0<t<4 2. 10= 43 ae 
0, $t>4 , 
8.10 = 43 oO 4. f(t)= [4, 0<t<10 
0, t>10 
0, O0<t<5 
= _ (90, 0<t<3 
s 10-42 i 6. f(t) = 6, 3<t<9 
, 0, t>9 
jt 0<t<3 _ jt, O<t<5 
|. t>3 8. 10= {56 5 
t, O<t<l t, O<t<l 
o fi=a< do 1eg<o 10. fO=< F, 1a 
0, t>2 0, $t<2 
1, O0<t<2 
2, 2<t<3 
11. f(t) = 3, 3<t<5 
0, t>5 


12. Derive the solutions of Equation (7.6). 


In Problems 13-22, use Theorem 7.1.1 to evaluate the given integral. 
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of the Laplace Transform 


13. im t) cost dt 14. f 5(t-5) sin t dt 

1s. [4 d(t — 2)e* dt 16. | 6(t —5)e* sint dt 
poo. Pe po 

ar. [4 o(t 2) "nat 1. [ d(t — 1) arctan t dt 
co Sa co 
3 1 

19. ies 1+e *)d(¢ — 2) dt 20. | (1 +e *)d(t — 2) dt 
0 —2 


2 
21. / cos 2td(t 


1 


22. i: (e** + £)d(¢ + 2) dt 
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7.2 Fundamentals of the Laplace Transform 


We now formally introduce the Laplace transform of a function f. 


Definition 7.2.1 
Let f be a real-valued function of the real variable t, defined for t > 0. 
Consider the function F' defined by 


F(s)= i en fiat (7.18) 
for all values of s for which this integral exists. The function F is called 


the Laplace transform of the function f. We denote the Laplace trans- 
form F of f by £{f} and denote F(s) by L{ f(t)}. 


Remark 1: The lower limit of integration is given as 0~ to account for spe- 
cial functions such as the idealized unit impulse, 5(¢). If there is no problem 
with the limit at 0, we will just write 0 for the lower limit (instead of 07). 
While this distinction differs from many of the current popular introductory 
differential equations texts, we refer the reader to [36] for a more detailed 
discussion of why this distinction is crucial from both a mathematical and 
engineering perspective. 

Remark 2: Since the integral in (7.18) is improper, it may not exist for 
every function f for which we might wish to compute the Laplace transform. 
Conditions will often have to be imposed upon f in order for this integral to 
exist. 

Remark 3: In this definition, the integral is with respect to the variable t, 
with s a “dummy” variable for the integral. Thus, the Laplace transform of 
f(t) will produce a function of s. We will allow s to be complex; however, 
many results we obtain will only depend on the real part of s. Thus, for 
convenience, we will often consider a real-valued s and will specifically note 
when we intend s to have a non-zero imaginary part. 
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Calculation of Laplace Transforms 


Using the definition, it is not difficult to calculate the Laplace transform of 
familiar functions. We now present several examples to illustrate this concept. 


|Example 1:| For the function f(t) = 1 for all ¢ > 0, the Laplace transform 


is 
co co =| 
; e *.1dt= | e *dt= lim —e* 
0 0 k- oo Ss 


le ce el 
k-+co = 6S s 


L{1} 


lI 
= 
B 
o 


=. for alls > 0 
8 


sO 


L{i}=-, for s>0, 


1 
s 
which is a function of s as expected. - 


| Example 2:| Let f(t) =t, t > 0; then integrating by parts gives the Laplace 


transform as 


CO lo e) 
Li{t} = ‘| et .tdt= | te~** dt 
0 0 
k 1 love) 
= lim —-e %| + al e* dt 
k-+0o Ss 0 s 0 
k 
1 Hl 
=. lim —- We | = 
k-oo s2 0 s2 
Hence 1 
L{t}=-—, for s>0 
8 ea) 


| Example 3:| For the function f(t) = e”, for t > 0, the Laplace transform 


is found from 
Lie t= | e %e% dt = | e(t—s)t dt 
1) ) 


0 k00 0 — 8S a—s 


so that if s > a, then e“*—5)* + 0 as k > oo, thus 


1 
Lie) = = if s >a. 
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We mention at this point that the three examples so far have been with a 
real-valued s. In this next example, we revisit Example 1 for a complex-valued 
5. 


| Example 1 revisited: | eS VSS) Consider again the function f(t) = 1 for all t > 0 


and let s = a+i. The Laplace transform is 


cil} =| en. dt 
0 


k 
—1 
= lm —e* 
k-oo s 0 
es e~ “*(cos(Gt) + isin(Gt)) . 
k- oo Ss 0 


Because cos and sin are bounded functions, we see that this limit will converge 
if a > 0 and will diverge if a < 0. Thus, for complex s, we have 


1 
L{l}= a for Re(s) > 0, 


which agrees with our results in Example 1 when we only considered a real- 


valued s. 
iia 


| Example 4: | = For f(t) =sinbt, t > 0, the Laplace transform is found from 


L{sin bt} = | e * sin bt dt. 
0 


Integrating by parts twice, 


st 


—bcos bte~*! —ssin bt e7 
—st_: _ 
Je ®* sin bt dt = ae ae for s > 0. 


Thus 


foe) k 
| e *' sin btdt = lim | e * sin bt dt 
0 0 


k-o0o 
—bcos bte~** — ssin bt e7**|* 
=| lim 
kco = 8 + s?+h? |, 


—b 
= lim | a toes bee **) — ERD sin bk a] 


k—-00 


=U... 0 
ave ) =| 
ob 
= s2 + h2’ 
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so 
b 


L{sin bt} = e475" Ss 
Ss 


> 0. 
A similar calculation shows that 


Li{cos bt} = Sear for s > 0. 


| Example 5: | We previously considered the unit step function, defined as 


0 t<a 
val) = {5 t>a. 


In our definition of the Laplace transform, we wrote the lower limit as 07 
in order to incorporate any discontinuities into the transform. The unit step 
function U,, with a = 0 a possibility, satisfies the conditions of the existence 
theorem for Laplace transforms so that L{U,(t)} exists. Thus 


£L{Ua(t)} = eu ,(tyat = | coat [ e~** dt 


6= = 2 
k enst | 
= lim e *dt= lim — 
k-0o a= k-0o Ss iH 
—e sk + e784 e7 8a 
= lim = 
k—0o Ss Ss 
Thus we have 
e348 
L{Va(t)} = , &>0 
Ss 


Note that for a > 0, we include the discontinuity with a~. We can use unit 


step functions to express other step functions. = 


Using the familiar property of the integral that the integral of a sum is the 
sum of the integrals, we say that the Laplace transform is linear. 


THEOREM 7.2.1 Linearity 
Let f; and f2 be functions whose Laplace transform exists and let Cy and 
C2 be constants. Then, 


LAC fit) + Cofa(t)} = CiL{filt)} + CoLl{fo(t)}. 
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| Example 6: | ©) We previously showed that 


0 O0<t<2 
ft()=43 2<t<5 = 3Uea(t) — 3Us(t). 
0 t>5 


Then 


L{f(t)} = L{3U2(t) — 8U5(t)} = 3L{U2(t)} — 3L{Us(t)} 
3 e 28 3 es = 3 e 


| Example 4 revisited: | SESS) Use the linearity property of the Laplace transform 


and Euler’s formula to obtain £{sin bt} and L{sin bt}. 


Solution 
From Example 3, we have that L{e"} = + if s > a. Thus, we can write 


L{cos(bt) + isin(bt)} = L{et} 


=x, dh = 1 st ab 
s—ib s—ib s+ib 
= 4. (7.19) 
We obtain our desired transforms with 
L{cos(bt)} = Re(L{el}) = 5 ~ a 
L{sin(bt)} = Im(L{e™}) = Pape: 
fi 


Another useful property concerning the nth derivative of the Laplace trans- 
form of a function f(t) is given in the next theorem. 


THEOREM 7.2.2 
Suppose the real function f is integrable on every finite closed subinterval 
of a <t < ~w, with the Laplace transform F' given by 


186) = i en Ry at. 
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| Example 7:| To find L{t? sin bt}, we have 


d2 
L{t? sin bt} = (—1)?—, F(s) 
ds? 
where 
. b 
F(s) => L{sin bt} => ep 
and 
dF = —2bs 
ds (s? + b)? 
F _ 6bs? — 2b? 
ds2 (s2 + b?)3’ 
so that 5 : 
6bs* — sb 
Oe sin bt} = —.——..... 
(s? + B2)3 = 


In each of these examples, we have seen that the integral (7.18) exists for 
some (possibly infinite) range of values of s. Does the Laplace transform 
always exist? The answer is “No,” as we will shortly see. We will now inves- 
tigate conditions for which the transform does exist. 


Existence of the Laplace Transform 


We will introduce a few ideas to help us determine when the Laplace trans- 
form exists. The next definition will allow us to determine a class of functions 
for which the transform always exists. The next definition will allow us to 
determine how fast a function grows. 


Definition 7.2.2 
A function f is said to be of exponential order if there exists a constant 
a and positive constants to and M such that 


|f(t)| < Me™ 


for allt > to at which f(t) is defined. More explicitly, if f is of exponential 
order corresponding to some definite constant a, then we say that f is 
of exponential order e™. 
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In other words, we say f is of exponential order if a constant a exists such 
that the product e~™|f(t)| is bounded for all sufficiently large values of t, so 
that the values of | f(t)| cannot become infinite more rapidly than a multiple of 
some exponential function e®’. Note that if f is of exponential order e®’, then 
f is also of exponential order e®* for any 8 > a. Now clearly every bounded 
function is of exponential order, with constant a = 0. So, for instance, sin bt 
and cosbt are of exponential order. The next few examples consider some 
combinations of familiar functions. 


| Example 8:| “2 For the function f(t) = e” sin bt, f(t) is of exponential order 


with constant a = a, since 
el #(t)| = e~ **e%*| sin bt| = | sin be| 


which is bounded for all t. a 


ees" Consider the function f(t) =t”, where n > 0. Then 


eW | F(t)| = et". 


Now for any a > 0, 


lim et” = 0. 
t-0o 


This means there exists M > 0 and to > 0 so that 
ef (t)| =e Mt” <M for t > to. 


Thus f(t) = t” is of exponential order, with the constant a equal to any pos- 
itive number. 


a 
ESOS The function f(t) =e! is not of exponential order, as 
cP =e" 
which is unbounded as t + oo no matter the value of a. ™ 


To apply these ideas, we need a familiar result from calculus. This result gives 
a condition for the existence of an improper integral. 
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THEOREM 7.2.3 Comparison Test for Improper Inte- 
grals 
Let g and G be real functions such that 


0< g(t) <G(t) ona<t<o. 


Suppose 
i G(t) dt exists, 


and g is integrable on every finite closed subinterval of a < t < oo. Then 


i g(t) dt exists. 


The function G is sometimes called a dominating function or majorizing 
function. The comparison test gives the next result since g(t) < |g(t)| for 
any function g(t). 


THEOREM 7.2.4 
Suppose the real function g is integrable on every finite closed subinterval 
of a <t < co and suppose 


/ \g(t)|dt exists. 


Then i g(t) dt exists. 


With these two results in place, we can now state and prove an existence 
theorem for Laplace transforms. 


THEOREM 7.2.5 
Let f be a real function that has the following properties: 
(1) f is piecewise continuous in every finite closed interval 0 < t < b,b > 
0 
(2) f is of exponential order, that is, there exists a, M > 0 and ty > 0 
so that 

en Ol =i More = tp. 


Then the Laplace transform 


ctn= fe p(mar 


of f exists for s > a. 
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Proof: We have 
oe) to foe) 
| epQar= f et p(t at f e F(t) dt. 
= = £6 


Now by hypothesis (1), the first integral on the right exists. 
Considering the second integral, by hypothesis (2) we have 


e "| F(t)| < e Me _ Me7 > Mt tone Ss bis 


Also, 
ec) —M —(s—a)t k 
| Me-&-)! dt = lim ————_—_ 
to k—-0o S—-aQ to 
= lim M (e~ (S-a)to = g Gay 
k-0o S—a 
M 
= |=] e S-M)0 if s> aq, 
So= ia 
Thus 


/ Me~“-™* dt exists for s > a. 
to 


Now by hypothesis (1), e~*’|f(¢)| is integrable on every finite closed subinter- 
val of tg < t < co so applying the comparison test with 


g(t) =e “| F (2)| 


and 
G(t) = Me~&- 
we see that Zn 
/ e “|f(t)|dt exists for s > a. 
to 
That is, 
/ le" f(t)|dt exists for s > a. 
to 
Thus, 


/ e *f(t)dt also exists if s > a. 


to 


So the Laplace transform of f exists for s > a. ll 


If we look at the proof, we have actually shown that if f is as stated, then 


/ e*|f(t)|dt exists if s >a. 


to 
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Further, hypothesis 1 shows that 


to 
| e *"| f(t)| dt exists. 


Thus es 
| e “|f(t)|dt exists if s >a, 


so not only does L{ f(t)} exist, but so does £{|f(t)|} for s > a. More precisely, 
we say that a e*' f(t) dt is absolutely convergent for s > a. 


It should be pointed out that the conditions on f described in the hypothe- 
sis of the theorem are not necessary for the existence of L{f}; however, there 
are functions f that do not satisfy the hypothesis of the theorem but for which 
L{f} exists. For instance, suppose we replace hypothesis 1 with the less re- 
strictive condition that f is piecewise continuous in every finite closed interval 
a <t <b where a > 0, and is such that t" f(t) remains bounded as t > 0* 
for some 0 < n < 1. Then, provided hypothesis 2 remains satisfied, it can be 
shown that £{f} still exists. 


Consider the function f(t) = t~3, t > 0; then it can be 
shown that L{f} exists. Although f does not satisfy the hypothesis of the 
theorem [f(t) + oo as t + OT] it does satisfy the less restrictive requirement 


stated above (with n = =) and is indeed of exponential order. = 


Laplace Transform of Derivatives 


Since we seek to apply Laplace transforms to differential equations, we need 
to know how they affect the derivative of a function. 


THEOREM 7.2.6 Differentiation 

Let f be a real function that is continuous for t > 0 and of exponential 
order e® and suppose f’ is piecewise continuous in every finite closed 
interval 0 <t < b. Then 


L{f'} exists for s >a and 


L{f'(t)} = sL{f(t)} — f@ ). (7.20) 


Recall that we use 0~ as the lower limit of integration and this arises in the 
above formula. We often refer to f(0~) as a pre-initial condition. 


Proof: Since 


cfrop= fe rovar 
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integrating by parts gives 
k oo 
+ | e*' f(t) dt 
o- 


L{f'(H} = jim e f(t) : 
= lim e**f(k) — fO-) + sL{F(} 


= sL{f(t)}} —f(0-) (since f is of exponential order 1). il 


The relation between the pre-initial condition given in (7.20) and the post- 
initial-value f(0*) is given by 


lim sF(s) = f(0*), (7.21) 


s—oo 


where we specify that the limit is taken along the positive real axis since s 
may be complex. As mentioned earlier, we will often write 0 instead of 07 if 
there is not a problem at 0. 


If f(t) = sin? at, then f’(t) = 2asinat cos at so that 


L{2asin at cos at} = sL{sin? at} 


2a? 2a? 
= $ = . 
s(s? + 4a?) s? + 4a? 


In a very similar manner, it is also possible to consider higher-order deriva- 
tives. 


THEOREM 7.2.7 Higher-Order Derivatives 

Let f be a real function having a continuous (n — 1)5* derivative f‘ 
for t > 0 and suppose f, f’,...,f("~) are all of exponential order e. 
Further suppose f‘” is piecewise continuous. Then L{f™} exists for 
s >a and 


LL FO (} = s"L{F)}— sY FO) 
= 0B a On ne 0g) 


n—1) 


The proof of Theorem 7.2.7 follows from induction on the previous theorem. 


| Example 13:| To find £{sin bt}, we proceed as follows: 
L{f"(t)} = PLL F()} — sf(0) — f'O), (7.22) 


so that we have 
f(t) =sin bt so f(0) = 0. 
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Further, 
f' (t) = bcos bt gives f’(0) = b and f(t) = —b? sin bt. 
This yields 
L{—b’ sin bt} = s’L{sin bt} — b, applying (7.22). 


Simplifying 
(s? + b?)L{sin bt} = b 


and solving for £{sin bt} we have 


b 
L{sin bt} = +—~ 
yan) s? + 6? 
which agrees with Example 4 of this section. - 
e e e e e e e e e e e e 


Problems 


In Problems 1-11, use the definition of the Laplace transform to find L{ f(t)} 
for each of the given functions f(t). If 2{f(t)} exists, give the domain for 


F(s) = L{f()}- 


Lf = 2.4) =3e-" 3. f(t) =t-3 
A. f(t) = te 5. f(t) = |t—2| 6. f(t) = tetvt 
7. f(¢)=sinht 8. (i) = 28e' 27H) = {2 O0<t<a 
3 t>A4 
t, O<t<l t, O<t<l 
Li fHS< 1, Lee OS <ey Lets. 
0, t>2 0, t>2 


In Problems 12-32, using the properties of the Laplace transform developed in 
this section, find the Laplace transform L{ f(t)} for each of the given functions 


f(t). 
12. f(t)=t+sint 13. f(t) =t— 
14. f(t) =| — 5 15. f (2) = cos? 
16. f(t) = cos? at; a, a constant 17. f(t)= singin 
18. f(t) = sinat sin bt a,b constants 19. f(t) =sin 
20. f(t) =sin® tcost 
0<t<4 0, O<t<6 
21. f= {9 ie? 22. F()= {9 7 
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0, O0<t<5 
23. f(t)= f4, O0<t<10 24. f(t)=¢ 2, 5<t<7 
0, t>410 Ol £6 
1, O0<t<2 
0, O<t< 3 _jJ2, 2<t<3 
25. f(t) = _@ Sere 26. f(t) = & Seb sg 
0, t>9 0, ¢>5 
1, O<t<2 
27. f(t)=20, 2<t<6 as. fae DEES 
3). £3 
1, t>6 
2t, O<t<5 _ J 9, 0<t<l 
29. f(t)= ae eon 30. f(y = {0 pod 
0, 0<t<4 6, 0<t<l 
31. f(t)=4t-4, 4<t<7 32. f(t) = 4 8-—2t, 1<t<3 
3, t>7 2 LS 


From a table of integrals 


/ o sin budu = ete sin bu — bcos bu 
a? + OF 


/ e* cos bu du = e* ates hu belay 
a? + b? 


Use the integrals to find the Laplace transform L{ f(t)} of the following func- 
tions in Problems 33-34. 


33. f(t) = cosat 
35. 


36. 


34. f(t) =sinat 


Another useful property of Laplace transforms can be given as follows: if 
L{f (t)} = F(s) exists for some s > a for a function f(t) in which f(t)/t 
is bounded for ¢t > 0, then 


(7.23) 


(a) Verify (7.23) by writing F(y) = iz e 4 f(t) dt and integrating both 
0 


sides from y = s to y = 00. 
(b) Using the definition of the Laplace transform, observe the troubles 
in evaluating £ { 224}. 


(c) Using (7.23) evaluate £ {224}. 
The gamma function I'(q@) is defined as 


T(a) =| a*te-"dz fora>0, 
0 


which simplifies to [(n) = (n — 1)! for natural numbers. We will explore 
further properties of the gamma function in the next chapter. In this 
problem, using the definition, show that 


(a+ 1) 


FE 
Li{t*}= sori fora >-—l. 


526 Chapter 7. Laplace Transforms 


37. Using the results of Problem 36, find the following Laplace transforms: 


(a) £{ 4} (b) L{vi} (c) £{t°/?}. 

38. Let f(t) and g(t) be of exponential order. Show that their sum f(t)+ g(t) 
is also of exponential order. 

39. Let f(t) and g(t) be piecewise continuous on a < t < b. Show that their 
sum f(t) + g(t) is also piecewise continuous on a < t < b. 

40. Using the results of Problems 38 and 39 show 


L{f(t) + g(t)} = {FO} + Lta(bh- 


41. Show that the function f(t) = 3sin(e" ) is of exponential order but that 
its derivative is not. 


7.3 The Inverse Laplace Transform 


Thus far our work has been centered upon the problem: Given a function 
f, find its Laplace transform L{f(t)}. The next question for us to pursue is 
given a function F’, find a function f whose Laplace transform is the given F’. 

We introduce the notation £~1{F} to denote such a function f, i-e., 


f(t) =L-'{F(s)}, 


which means L{ f (t)} = F(s). £7? is called the inverse Laplace transform. 
There are now three questions that we need to consider: 

1. Given a function F’, does an inverse transform exist? 

2. If it exists, is it unique? 

3. How do you find it? 

These questions have different levels of import in our considerations here, 
from very theoretical mathematics to very practical. We will first answer 
question 2. 


THEOREM 7.3.1 — (Uniqueness) 
Let f and g be two functions that are continuous for t > 0 and that have 
the same Laplace transform, that is, 


L{F(t)} = Ltg(t)}, 
then f(t) = g(t) for allt > 0. 


Remark: In probability theory the uniqueness theorem plays an essential 
role in the theory of moment generating functions (m.g.f.) where the unique- 
ness is essential for determining the distribution of a random variable. 
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We must emphasize that in the uniqueness theorem the function is contin- 
uous, as the next example clarifies. 


| Example 1:| Consider 


1 0<t<3 
gt)=42 t=3 
1 bs 


Then 
co 3 foe) 
Li{g(t)} = / e "gi de= | e * dt +f e* dt 
0 0 3 
1 
=- ifs > 0. 
Ss 
This, however, is also the Laplace transform of 1, i.e., 


1 
L£{1}=- now clearly g(t) 41 for allt. 
s 


Thus, this discontinuous function g is also an inverse transform of F’ defined by 


However, the only continuous inverse transform of F(s) = + is f(t) = 1 for 
all t so that the unique continuous inverse transform is 


ey 


This is how we address uniqueness. We require continuity of the inverse trans- 
form. 


Question: How do we compute inverse Laplace transforms? 


This is an important question for us. However, we will not directly compute 
inverse transforms in this text. We will refer to Table 7.1 to give us some often- 
used transforms. We note, however, that the uniqueness property allows us 
to conclude that the inverse Laplace transform is also a linear operator. That 
is, 


Lo} {C\ Fi(s) + C2 Fo(s)} = \ mes {C\ Fi(s)} + ce {C2F2(s)} . (7.24) 


As with all tables, certain preliminary manipulations might be required to 
put a given F(s) into a form present in the table. Often partial fraction de- 
composition is required. Of course, with MATLAB, Maple, or Mathematica, 
our job is much easier as will be seen at the end of the chapter. 
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Table 7.1: Table of Laplace Transforms 


oh — ee ey F(s) =L{f(t)} Covered in text 
i 
il, dl 3 Sec. 7.2, Example 1 
Dae = a Sec. 7.2, Example 3 
b 
3. sin bt pe Sec. 7.2, Example 4 
4. cosbt 2 z= R Sec. 7.2, Example 4 
b 
5, sinh bt pe Sec. ep eros 10 
6. cosh bt = Chap. Rev. Prob. 13 
! 
7. t#(n=1,2,...) aH Chap. Rev. Prob. 19 
8. (a >—1) cee Sec. 7.2, Prob. 36 
! 
9. te (n =1,2,...) G Sale 5 Chap. Rev. Prob. 20 
2b 
s¢— 67 
iil, weos bt (2+R)2 Chap. Rev. Prob. 16 
b 
aE . 
12. e~™ sin bt ee Ee apne Sec. 7.4, Example 2 
ap Gh 
13. e-2 z _ Rev. Prob. 
Sueme COsiUb one Chap. Rev. Prob. 14 
sin bt — bt cos bt 1 
t sin bt 8 
16. 0) a Sec. 7.2, Example 5 
17. Ua(t)f(t — a) e * F(s) Sec. 7.4, Thrm. 7.4.2 
182 eo" (a) F(s—a) Sec. 7.4, Thrm. 7.4.1 
19. d(t — to) esto Sec. 7.4, Thrm. 7.4.3 
] (0). i 
20. Int aus ai TS ens See Sec. 8.5 


8 Euler’s constant; 
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: 12 
Example 2: [twee + 


Ss 


s—5 


Solution 

Because of the linearity of the inverse transform, we can consider each of the 
terms in the sum separately. In addition, the s+ in the denominator of the 
first term should make us think of entry 7 in the table and the second term 
should make us think of entry 2 in the table. Thus we write 


12 1 3! 1 
-1J +4 — 9-1 1-1 
ee 


= oP +2. (7.25) 
i 
Example 3: [wae 1 
" 32 +6s+13 f° 
Solution 
We look for i 
F(s) = —————_ 
(s) as? +bs+c 


in the table but there is no such critter; we do, however, find 


b 
(s +a)? + b?° 


Thus we rewrite 
s?+6s+13= 5? +6s+9+4=(s84+3)? +4. 


Hence 1 _ 1 1 2 
s?+6s+13  (s+3)2+4 2(s+3)2+2?° 


So 


1 1 2 
Loi = foi 
\arer} 2 \cuarcs} 
1 
2 


= —e * gin 2¢. 
|_| 
Example 4: Fg ja f=1 I 
ompute ae fi) |" 
Solution 
By partial fractions, 
1 _ A, Bete 
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so that 


A=1, B=-1, andC=0. 


? 


Thus 


which means 


7.3.1 Laplace Transform Solution of Linear Differential Equa- 
tions 


Armed with the ability to calculate some of the basic inverse Laplace Trans- 
forms, we now look at a few examples in which we apply them to solve initial- 
value problems consisting of an nth order linear differential equation with a 
specified initial condition. 


The Method: 
Consider the nth-order linear differential equation with constant coeffi- 
cients: 
d”y d’—ly dy 


dtr-1 “the ae acer + ay = b(t) 


which satisfies the initial conditions 
y(0) = co, y/(0) = c1,...,y"-) (0) = cn_1. 
The existence theorem in Chapter 4 ensures that this initial-value problem 


has a unique solution. Thus if we now take the Laplace transform of the 
differential equation, 


d"y d’—ly dy 


Each Laplace transform is given as 


{ae} = s"£{y(t)} — s"-1y(0) — s”~?y"(0) — ... — y*(0) 


= s"L£iy(t)} — es” * — ys™? —...— Ga 
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ay n= n—2 n—-3,1 (n—2 
Ly saat p = 8" NLfy(t)} — 82 y(0) = 8" Fyh(0) =... = y" (0) 


= ss" L{y(t)} — cps”? — cis? —. 0 — Cae 


£{ Eh — sctu(t)} ~ a0) = se{ul)} ~ o 
Now letting Y(s) = L{y(t)} and B(s) = L{b(t)} we obtain 


1 2 


[ans” + an_18” *+---+a18 + ag/¥(s) — colans” | +an_1s” 7 +---+a)] 


=, =3 
= Ons Glas Ps aa] 


— Cn—2[An8 + On—i] — Cn—1dn = B(s). 


This is an algebraic equation in the “unknown” Y(s). We solve this equation 
for Y(s) so that 


y(t) = £{Y(s)}. 
The idea presented here is one of the main features of the Laplace transform. 
It allows a differential equation to be expressed as an algebraic equation that 


can be solved easily. Once the algebraic equation is solved, the inverse Laplace 
transform is applied to recover the solution of the differential equation. 


| Example 5: | Solve the initial-value problem 


Solution 
Taking Laplace transforms of both sides of the differential equation gives 


c{ Eh — actult)) = cep. 


dt 
Now F 
c{ ah = s£{y(t)} — ¥(0), 
letting 
¥(s) = L{y(s)} 
sO 
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Thus 
sY(s) -3—2Y(s) =Lf{e"} = G a 5)’ 

so i 

(s —2)Y(s)-—3= —— 
Solving for Y(s) gives 

(s — 2)Y(s) = — +3 
= ¥ia= 3s — 14 

(s —5)(s— 2) 


Now we find y(t), ar, 
W= EN EHH 


Applying partial fractions 


3s — 14 A B 
(s—5)(s—2) s—5 s-—2 


gives 
3s — 14 = A(s — 2) + B(s —5) 


so that 


This implies 


Thus 


is the solution of the initial-value problem. 


|_| 
| Example 6: | Solve the initial-value problem. 
dy  idy 
Se Qa 
an oe 


y(0) =3, y'(0) =6. 
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Solution 
Taking the Laplace transform of both sides of the differential equation gives 


is {ah OL { ah 8L{y} = L{O}. 


Now 
c{ Fh =#¥06)- su -VO 
where 
Y(s) = Lty(t)}; 
also 
£{ Eh =s¥(s)- 0 
Thus 
s"¥ (s) — 3s — 6 — 2(sY(s) — 3) — 8Y(s) =0, 

which is 


[s* — 2s — 8]Y(s) — 3s =0. 
Solving for Y(s) gives 


38 

a) 5s? —2s— 8’ 
which is 3 
Ss 

Y(s) = ————_—_.. 

= ay) 


We find Y(t) by applying the inverse transform 


vO=£" opera} 


Using partial fractions 


38 _ A B 
(s—4)(s+2) 38-4 ' g+2 
gives the solution 
A=2, B=1 
Thus 
35 1 1 
fois — sk = ar} f Le 
\ocascs} {sa} + s+2 
= Qe4* 4 7". 


So the solution of the initial problem is 


Y(t) = 2e* +e”, 
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Laplace transforms can sometimes be used to solve initial-value problems 
involving linear differential equations with nonconstant coefficients. However, 
Laplace transforms do not provide a general method for solving equations 
with nonconstant coefficients. 


|Example 7:| Solve y” + 4ty’ — 8y = 4 with the initial conditions y(0) = 
y y y 


0, y’(0) = 0. 
Solution 
Applying the Laplace transform to both sides of the equation gives 
L{y!"} + 4Lf{ty’} — 8L£{y} = L{4}. (7.26) 
Now recall pe 
AAO POE = (“DY ALO} 
so that 


£fty’} =~ £fy'} = -S1s¥(5) — y(0) 
= —sY'(s) — Y(s). 


Applying this to Equation (7.26), we have 


s°Y(s) — sy(0) — y'(0) +4[-sY’(s) — Y(s)] — 8Y(s) = . 
Simplifying, we obtain 
(s? — 12)¥(s) —4sY’(s) = S 


which is a first-order differential that can be solved for Y(s). Rewriting this 
equation as 


we see that this is a first-order linear differential equation. An integrating 
factor for this equation is 
2 
u(s) = s°e-* /8, 

and upon applying this integrating factor from Section 1.6 (or other method), 
we obtain the solution 2) 

a: ger? 
Now if y(t) = L~!{Y(s)} exists, then 


lim Y(s) = 0. 


s—>0o 
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Thus, here c = 0, so 
Using this 


y(t) =L7'{Y(s)} =2L71 {5} 
= 2t?. il 


The next example gives the general solution for a mass-spring system in 
terms of the Laplace transform. The latter part of the example considers a 
discontinuous forcing function. 


peel) Mass on a Spring (revisited) 


As we saw in Chapter 4, the motion of a mass suspended on a spring satisfies 
the differential equation 

me x 

= pa ka = 

mos +b + ke = f(b) 
where m is the mass, b is a damping coefficient, k the spring constant, and f(t) 
is a forcing function. The displacement of the mass also satisfies the initial 
conditions «(0) = a and 2’(0) = vp. So applying the Laplace transform to 
the differential equation gives 


ax dx 
£{m ate ke} = Lf f(t}. 


So 


mL {G \. bL 3 aE 4 tkL{a} = L{f(t)} 
which is 
m|s*L{x} — xos — vo] + b[sL{x} — xo] + kL{x} = L{ f(t}. 
Letting X = £{x} and rewriting this expression gives 


(ms? + bs + k)X — maps — mug — bry = L{ f(t}. 


Thus 
L{ f(t)} + m(xos + vo) + bro 


ms? +bs+k 
Applying the inverse transform gives 


4 {a} +m/(xos + v0) + “0 . 


X= 


a(t)=L 


ms? +bs+k 


Of course, this is a very general expression for the displacement function x(t) 


of a mass on a spring. A specific example is considered next. = 


536 Chapter 7. Laplace Transforms 


| Example 9: | “= Consider the result of the Example 8 for the case of forced un- 


damped motion described by 
x" + 4x = sin 3t 


with x(0) = x'(0) = 0. Then since L{f(t)} = L{sin3t} = 5 and m = 
1,b=0,k = 4, ro = 0, vp = 0 we have 


Applying partial fractions gives 


3 ow ae af 4 
(s2+9)(s2+4) 5 (=73) 5 (=z) 
By 2 1/3 
“ae ae 


2 3 
ctl} =sin2t and ct{ a} = sin 3t. 
Ss 


1 
x(t) = 7 sin 2t — 5 sin 3t 


Thus 


is the displacement. 


il 

e e e e e e e e e e © e 
Problems 
Find £~!{F(s)} for each of the functions F'(s) in Problems 1-16. 
1. F(s) = wr, 2. F(s) = = ; 3. F(s) = = 

oe s4+2 s+6 
4, F(s) = Fy4st4 . F(s) = Fads FT F(s)= Pr 8+0 
7. Oar er 8. F(s) = Tage OP = aye 
10. Fs) = Bo LL. FQ) = soe 12. Fs) = are 5 
13. F(s) = ae ce aaa ke Bo 
15. F(s) = ae a 16. F(s) = — 


For each of the Problems 17-31, use Laplace transforms to solve each of the 
initial-value problems. 


7.4. Translated, Delta, and Periodic Functions 537 


17. y'’-y=e**, y(0) =2 18. y' + y = 3e”*, y(0) =—-1 
19. y” + 4y =0, y(0) = 2,y'(0) =3 20. y” + 1l6y =0, y(0) = 7, y'(0) =0 
21. y"” +9y =4, y(0) =0,y'(0) =6 22. y—-y’—6y = 0, y(0) = 2, y'(0) =6 


23. y” — 5y’ + by = 0, y(0) = 1, y/(0 

24. y"” +y' — 12y =0, y(0) = 4,y/(0) = -1 
25. y” + 2y' + 5y = 0, y(0) = 2, y/(0 

26. y+ Oy +y=te™, y(0) = 2, y’(0) 
27. y" — 8y' + 15y = 6te**, y(0) =5, y/(0) 

28. y” —y' — 2y = 13e~* sin 3t, y(0) =0, y/(0) = 
29. y” + 3y’ — 10y = 50e7* cost, y(0)=—1, y’(0) 

30. yy!” — 5y” + Ty’ — 3y = 20sint, y(0) =0, y/(0) =0, y”(0) = —2 
31. y’” — 6y” + 1ly’ — 6y = 19te*, y(0)=—1, x’ 


7.4 Translated Functions, Delta Function, and Periodic 
Functions 


Now that we have established the existence of the Laplace transform we 
will examine some additional properties and functions that will be very useful 
in certain applications. 

Our mass on a spring was sometimes forced with functions such as e™ sin(bt). 
We thus consider a useful property of the Laplace transform that will allow 
us to deal with this. 


THEOREM 7.4.1 Translation Property 
Suppose f is such that L{f} exists for s > a. Then for any constant a, 


L{e™ f(t)} = F(s—a) 


for any s > a+a, where F(s) = L{f(t)}. 


Proof: Let 
F(s) =L{f(t)} = * ome" f(t) dt 


sO 
F(s—a)= [- e (S—9)¢ F(t) dt = ; e *e™ f(t) dt = L{e™ f(t)}. 


The translation property aids in many calculations of L{ f(t)} as can be seen 
in the following examples. 


| Example 1:| Find L{et}. 


Solution 
1 
Now L{th= 2 for s > 0 
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6) F 
abel — f 
L{et} (e—ap ors >a 
|_| 
| Example 2:| Find L{e sin bt}. 
Solution 
We have L{sin bt} = aR 
so 
OC 
(s—a)? +b?" - 


Another useful property of the unit step function in connection with the 
Laplace transform is the translation of a function f(t) in a positive direction. 
That is, consider a new function defined by 


{" 0<t<a 
f(t-—a), t>a. 
Then since 
mO={t tsa 
we have 
Uae) = ee nue a 


Thus for Laplace transforms of this function we have the following result. 


THEOREM 7.4.2 


Suppose f is a function which has a Laplace transform F, i.e., 


FAG Ie i ” em F(t) dt. 


Then the translated function 


has Laplace transform 


L{Ualt) f(t — a)} =e MLL FM}. 
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Proof: We have 
L{Ualt)f(t—a)} = fe" vale) F(t =a) at 
-[ et odi+ fo esta) dt 


= [ e F(t — a) dt. 


We now change variables, letting 7 = t — a. Then 


=e “C{f()}. Ml 


| Example 3:| Find the Laplace transform of 


0, 0<t<5 
a= {ei 5, t>5. 
Solution 
We must express t — 3 for t > 5 in terms of t— 5. Thus t—3 =t—5+42 so 
0, 0<t<5 
HO} pga, i> 5 
which is 


UsONe-9)= 1% 5) 40 ae 


where f(t) =¢+ 2. Thus we need 


L{f(t)} = L{t+ 2} = L{t} + L{2} 
IL .2 


ss 
This gives Li{g(t)} = L{U,(t) f(t — 5)} =e SLL f(t} 
—5s 1 2 
=e =) + eae . 
sz g 
|| 
Op" 5) Find the Laplace transform of 


_ (0; Oates 
att) = { Bot >. 
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Solution 
We must express sint in terms of t — 5. Noting that sint = cos(t — 4), we 


have 
_ f90, Ont SS 
TO=4 een, t> 4. 


Usi(-3)=(0 . pa¢es 


eoali— =), t>4 


Hence 


where f(t) = cost. Thus, since 


Ss 


we have 


; 2 
Example 5: 57% Wee ic 5 a 


Solution 
This is of the form £~'{e~**F(s)} where a = 4 with F(s) = 4 + 2. Thus 


L-*{e* F(s)} = Ua) F(t — @) 


where 


f(t) = Fy} =f + 
=a0-* {a} +5£7% {2} 
= 2¢+5-1=2¢+ 5. 
So f(t — 4) = 2(t — 4) +5 = 2t— 3. Hence 
£NeF(3)} = Val Flt —4) = Valt(2t 8) 


= 0<t<4 


%—4, t>A. 
| 


| Example 6: We now reconsider our motivational example given by Equa- 


tion (7.1) from Section 7.1 in which the first-order electric circuit with an 
inductor and resistor has applied step voltage: 


Vo, O<t<l 


0 t>1. (7.27) 


tI + RI={ 
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Solution 
We rewrite the forcing function as a step function and then take the Laplace 
transform of both sides, £{ LI’ + RI} = L{Vo(1 — Ui (t))}, to obtain 


L[sY(s) - ¥(0)] + RY(s) =Vo- — 
Solving for Y(s) gives 
OO ee aaa 


We then need to find the inverse transform to obtain the solution in the 
original variable. We could either plug into one of the computer algebra 
systems or re-write slightly and then apply the rules that we have learned 
thus far: 


I(t) =£'{¥(s)}= Pe Ne at Ee 1a} 
L L 


= (1-e# ~ Ui (t) (a-e“")) 4+1(O)et. (7.28) 


Rearranging shows that this is exactly the solution we obtained in (7.2). 


In Section 7.1, we motivated the study of the Laplace transform with a step 
forcing function that we just showed in Example 4 was easier to solve using 
the Laplace transform. In order to re-consider Example 4 of Section 7.1 with 
a Dirac delta forcing function, we first need to know how to take its Laplace 
transform. 

The Laplace transform of 6(¢ — to) can easily be found: 


L{5(t —to)} = 6(t — to)e” ** dt 
“i d(t — to)e “e ** dt 
ae (by Theorem 7.1.1) (7.29) 


We note that our definition of the Laplace transform with 0~ as the lower 
limit was crucial in obtaining this result. An alternative derivation from the 
definition 6,(t — to) is pursued in the Problems. We state this result here for 
reference. 
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THEOREM 7.4.3 
For to => 0, 
LAd(t—to)} =e ™. 


| Example 7: | We again consider the first-order electric circuit with capaci- 


tor and resistor from Example 4 in Section 7.1, RQ’ + g = f(t), in which no 
voltage is applied from the initial t = 0 except for a voltage spike, V,, that is 
applied from t = 1 to t= 1.1. Use the Dirac delta function to find the voltage 
for any time t > 0. 


Solution 

As we derived in Section 7.1, the area under the Dirac delta function is 1 even 
though it has zero width. The voltage spike in our example is of height V, 
and width 0.1, which gives an area of 0.1V;. If we center our delta function 
in the middle of our interval, our voltage spike takes the form 


f(t) = 0.1V,6(t — 1.05). (7.30) 
Taking the Laplace transform of RQ’ + 2 = 0.1V,0(t — 1.05) gives 


Y(s) 


R[sY (s) — Y(0)] 4 Oo = Ieee 
Solving for Y(s) gives 
1Ve. 
7 a ae + Y (0) 
Y(s) — T 
S+ RC 


We then need to find the inverse transform to obtain the solution in the 
original variable. Doing so gives 


aw =e wiyp= et {he fO | 


R stag s+ ag 


0.1V; =(¢-1.08 4 
=F Uios(te “Ro 4. Q(0)eRe. (7.31) 


Rearranging shows that this is almost the same solution we obtained in (7.2). 
The main difference is the presence of a continuous rise in charge in (7.2) 
whereas this is represented by a step function in (7.31). Figure 7.6 shows that 
the solution using the idealized impulse gives an excellent approximation to 
the solution using a voltage spike of finite width. Of course, the solution via 
the Laplace transform was much quicker. The other item of note is the pres- 
ence of V,C in (7.2) whereas we have _ in (7.31). This may seem inconsistent 
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until we observe that the product RC is a constant for the circuit and is called 
the time constant.' That is, RC =const> V,C = V, - const =const: +. 
With this knowledge, the two formulas are equivalent. 


x L 
Finite width voltage spike solution 


=: = Idealized impulse voltage spike solution 


FIGURE 7.6: The solution (7.2) with voltage spike of width 0.1 and height 
V, as given in Section 7.1 is in blue. The solution (7.31) with idealized impulse 
function of the same area, 0.1V,6(t — 1.05). In both graphs, Q(0) = 3, R = 2, 
C =1, V; = 50. 


| Example 8: | ==) Consider the forced undamped motion described by 


x” + 9x = 36(t — 7) 


with «(0) = 1,2'(0) = 0. Then since £{F(t)} = 3L{d(t — 1)} = 3e77° and 
b=0,m = 9,29 = 1, v9 = 0 we have 


3e“* + 9s 
_ pl 
ae { Os? + 1 \ 


Now using the translation property, we have 
x(t) = cos 3t + sin 3(t — 7)u(t — 7) 
which can be written as 


z(t) = cos 3t, t<a 
“’ ) cos38t—sin3t, 7<t. 


‘Although it didn’t come up yet, we note that the time constant in an RL circuit is £. 
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We have now considered a step function and delta function as well as peri- 
odic function such as sin bt and cos bt. However, forcing function don’t need to 
be smooth periodic functions, and we could imagine a periodic step function 
or a periodic impulse. We thus need to address how to deal with periodic 
functions. Recall a function f(a) is periodic with period p if 


f(a@+p) = f(a) for all «x. 


THEOREM 7.4.4 
Suppose f is a periodic function of period P for which a Laplace transform 
L{f(t)} exists. Then 


eee dt 


li—e’s 


L{f(t)} = 


Proof: Since 


fore) P fore) 
cir = f et sar= f ep ats | e *' f(t) dt 


P 


it follows that we compute 


love) en at = oo ett?) - ia o-8P fore) ost | 

I f(t) dt i f(r+P)d | f(t) dt 
=e P £{ F(é)}. 

Thus 

coy= [sma re etso} 


so that 


[(P 
L{fl)} = Se. e—*' f(t) dt. 


| Example 9: | “>| Find the Laplace transform of 


1; 0<t<2 
fo={_y 2<t<4 


and f(t +4) = f(t) fort > 4. 


Solution 
This is a periodic function with period P = 4 as seen in the graph shown in 
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Figure 7.7. So 


LUf()} = hese 


1 2 4 
= ——_ e a+ | e *(-1 a 
Lge i 2 oy 


4 =e ° 2 a 6 cay 
= 


FIGURE 7.7: The piecewise defined periodic function of Example 9. 


=] 
Problems 
Find L{f (t)} for each of the functions f(t) in Problems 1-12. 
i. oo. 3. f(t) =e 
f(t) = e* sin 3t f(t) = e* cos 2t 6. f(t) = tUd(t) 
Tf) =t+ DU) 8. fl) =4(t—-1) 9. f(t) = (tm) 
10. f(t) = 6(t — ) cy f(t)=6(t-44+7) 12. f(t) = 6(t— 10) 


In Problems 13-22, find £~!{Y(s)} for each of the functions Y(s). 


1 3 
8 NO) G55 NO = yas 
15. ¥(s)= = 16. Y(s) = 
Ss 42st+5 As“jt4s+5 
e738 es 
19. Y(s) = —, 20. Y(s) = 


s4+3 
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—2s 


e 2 4 
21. Y(s) = ——— 22. ¥(s)=e * — 
s(s +3) : =e (a3 s 
23. Determine a value of to so that | sin?[m(t — t oat — 5) dt = . 
0 


5 
24. If | t”d(t — 2) dt = 8 what is the value of the exponent n? 
1 


t 


25.Sketch the graph of the function f(t) defined by f(t) = i d(v) dv, 


0 <t< oo. Can the graph be obtained from a unit step function? 


In Problems 26-31, solve the given initial-value problems using Laplace Trans- 


ue i, O<eeo 

26.2 +21") tS 2, with «(0) =0 

27.2" — 52’ +6x =U, (t), x(0) =0,2'(0) =1 

28. 2” — x = —206(t— 3), 2x(0) =1,2'(0) =0 

29.2” + 4x2 = d(t—4n), «x(0) = 1,2'(0) =0 

30. 7” + 4 = d0(t — 2m) cost, x(0) =0,2'(0) =1 

31. 2” 4+ 2a’ + 22 = 6(t— $) + cost, 2(0)=0,2'(0) =1 


32. The differential equation 
yw 


UE =r f(t) — Toy 


is used to describe the absorption of a drug by a body organ of volume v. 
The function y(t) is the concentration of the drug in the organ’s fluid at 
time t, and r; and ro are the rates of fluid flow into and out of the organ, 
respectively. The function f(t) is the concentration of the drug entering 
the organ. 

(a) If y(0) = 0 and r; = ro find y(t) if f(t) = t{1 — Ua (t)). 


(b) If y(0) =1 andr; Ar, find y(t) if f(t) = t[1 — Ua(6)]. 


33. A particular forced vibration of a mass m at the end of a vertical spring 
with spring constant k is described by the differential equation 


x 


my + ke(t) = 1+ Ui(t) — 202(t). 


(a) Describe what f(t) represents concerning the motion of the top of 
the spring. 


(b) Solve the differential equation for m = 1 and k = 4 with the initial 
conditions «(0) = x7’(0) = 0. 


(c) Plot the solution on 0 < ¢ < 10. Considering the driving function 
1+ U,(t) — 2U2(t), what do you observe? 
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34. Alternative derivation of Theorem 7.4.8. Define 


da(t — to) = 5 (Uip-alt) — Urgtalt)) 


so that lim, da(t—to) = 6(t—to) as in Equation (7.10). As can be justified 
as 


by the bounded convergence theorem, we have 
L{d(t — to)} = L{ lim da(t — to)} = lim L{6,(t — to)}. (7.32) 
a0 a—+0 


(a) Show that L{5q(t —ty)} = e~* ( © 


(b) Use (7.32) and your results from (a) to conclude Theorem 7.4.3. 


7.5 The *+Domain and Poles 


In signal processing and control systems, one often measures the impulse re- 
sponse and frequency response in order to gain information about the system 
that gave rise to the observed signal. This ties in with the Laplace transform, 
which we have seen transforms functions from the time domain (with variable 
t) to the frequency domain (with variable s). Using inverse Laplace trans- 
forms, we saw how we can obtain solutions in our original variables. However, 
we can actually determine very useful information about the behavior of the 
solution in the time-domain without transforming back to it. To see this, con- 
sider Example 8 of Section 7.3 in which we considered the general equation 
for a forced mass on a spring: 


dx dx 
—, +b— +kar = fit 
mp + - +ka = f(t) 
where m is the mass, b is a damping coefficient, k the spring constant, and 
f(t) is a forcing function. We let the initial conditions be written as «(0) = xo 
and «’(0) = vp so that the solution, via the Laplace transform, is 


L{ f(t)} + m(xos + vo) + bro \ 
ms? +bs+k , 


nial “Xie SL" { (7.33) 


A quick comparison with (7.33) shows that the characteristic equation, written 
with variable s instead of r, is in the denominator. Thus, the roots of the 
characteristic polynomial are the zeros of the denominator of X(s). We must 
keep in mind, though, that sometimes our roots were complex. Thus, we need 
to think of X(s) as a complex function. When we first defined the Laplace 
transform, we stated that s should be considered complex even if many of the 
results could be stated for a real-valued s. 
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We also note that the initial conditions will not affect the long-term behavior 
of the system nor will they determine whether the system has oscillations or 
not. However, in order to understand how an input F(t) affects a given system, 
we suppose that the initial conditions correspond to the homogeneous system 
starting from rest under this input at some definite time (for example, t = 0). 
Engineers often consider the following form of a forced linear time-invariant 
ODE: 


aoe d’—ly dx 
On Fe + An—1 pres +... a4 a tagu = f(t) (7.34) 
P(D)z 


for Qn,@n,—-1,-.-,@9 € R and P(D) the operator notation with the specific 
forcing function 


d™E dE dE 
= L Bin — ees L by E 
F(t) ‘ dt™ bm—1 Fem—t ia ee i) 
N(D)E 


where E(t) is the input to the system, bm,bm—1,-.-,bo0 € R, and N(D) is the 
operator notation. We will also assume n > m, since this will occur in most 
physical examples [45]. Then we define the transfer function of the linear 
time-invariant ODE (7.34)-(7.35) as 
L{x(t)} 

H(s) CiB(b)}" (7.36) 
If we think of the solution of the homogeneous equation as giving the normal 
response of the system (e.g., the mass-spring system), then the transfer func- 
tion is the ratio of the Laplace transforms of any normal response to the input 
that produces it [45]. We can simplify (7.36) by observing that the Laplace 
transform of (7.34)-(7.35) with “from rest” initial conditions gives 


dx dx dB dE 
£{ on Fe tba S rage} = £ {bm am +... +b, Tt meh, 
= 
(Qns” +--+ + as +a9)L{a(t)} (bms”™ +--+ +b15 + bo) L{E(t)} 


that is, P(s)L{ax(t)} = N(s)L{E(t)}, so that (7.36) becomes 


rine N(s) _ bms™ + bm—1s™ 1 +--+ +15 + bo (7.37) 
~ P(s) ans" + n—18"-! +--+ +4184 a9 | , 


The transfer function can also give us the frequency-response function 
given (compare with Equation (4.74)) if we replace s with iw. Engineers 
often refer to the ratio 2 as the gain factor. 


an 


|Example 1:| Consider the mass-spring systems with damping b from the 


dashpot: 
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k 
dashpot a 

[> dashpot 
: i a 


EF 
(a) (b) 
In Problems 11 and 12 of Section 4.7, the equations of motion were shown 
to be (a) ma” + ba’ + kx = bE’ and (b) ma” + ba! + ka = bE’ +kE. Find 


the transfer functions for each of these. 


Solution 
(a) Comparing the forcing terms to (7.35), we find that bg = 0, b; = b. Thus, 
(7.37) gives us the transfer function 


bs 
ms? +bs +k 


(b) Comparing with (7.35) we see that bp = k and b; = b. Thus, (7.37) gives 
us the transfer function 


H(s) = 


bs +k 


H(s) = —,—___.. 
ms? +bs +k el 


Engineers will often utilize the transfer function to gain information about 
the solution of the system rather than using the inverse Laplace transform to 
convert the function from the s-domain back to the t-domain. For example, in 
the mass-spring system it will often be preferable to gain information about 
the original system from the transfer function we obtained in Example 1 rather 
than through the inverse Laplace transform (7.33). This is the approach we 
use in this section. 

We have seen the singularities (i.e., the zeros in the denominators) of real- 
valued rational functions in calculus (or before) and we examined whether we 
had a vertical asymptote at this value or if a factor in the numerator actually 
cancelled with it so that we just had a hole in the graph. Since we will assume 
a complex-valued rational function, we briefly state some useful terminology. 

As we did in Section 3.5, we typically let w and z be the variables represent- 
ing complex numbers and N(z) and N(w) will be complex-valued functions. 
In this section, s will also be a complex variable. If N and P are two complex- 
valued polynomials, then } is a complex-valued rational function. We say 
that - is in reduced form if there are no factors in common. 


| Example 2: | Consider 


2 s+2 s+l 
g— 3" s? +45 + 37 s?+45+3° 


We note that s*+4s+3 = (s+3)(s+1). Then =; and »#+*,, are in reduced 


form. The third rational function is not in reduced form but canceling the 
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common factor allows us to re-write it in reduced form sa: - 


Definition 7.5.1 
Let pie be a rational complex-valued function in reduced form. A pole 


of 4 is defined as any value of s such that P(s) = 0. 


Besides its singularities, we will also examine the zeros of the function, i.e., 
the roots of the numerators. These will be important in obtaining information 
about the role a given forcing function has in the long-term behavior of the 
system. 


| Example 3:| Consider the rational functions 


2 s+2 s+l s(s +1) 
— b) =—— >——; d)———_——... 
3 Oar Oxyers ORFs 
Then (a) has a single pole at s=3 and no zeros; (b) has two poles—one at 
s = —37 and one at s = 37 and one zero at s = —2. We saw that (c) reduces 
so there is only one pole at s = —3 and no zeros. Finally, (d) has two poles 
at s = —5 and zeros at s = 0,-1. 


|Example 4:1 Consider the mass-spring systems considered in Example 1. 


Find the poles and zeros of the transfer function assuming «(0) = 2’(0) = 0. 


Solution 
In that example, we obtained the transfer functions 
bs bs +k 
j=" _ =. ). eS 
eye) ms? + bs +k’ es) ms? +bs+k 
Both have poles at s = x + = Vb? — 4mk. For (a), we have a zero at s = 0 
while for (b) we have a zero at s = —§. “ 


The zeros, sz, tell us that forcing functions of the form e*%- will have no 
effect on the system. In (a), this means forcing the system with E =constant 
will have no effect on the long-term solution. In (b), forcing the system with 
E = e—*/> will not have any effect on the system. 

For the poles we observe that they are exactly the roots of the character- 
istic equation and thus will determine those solutions that will grow versus 
decay and will even determine which decay fastest. For the physical mass- 
spring system it was always the case that the real part of the roots were 
negative and thus solutions always approached zero as t > oo. Although for 
a general transfer function H(s) it is not the case that the real part of a pole 
must be negative, it will always be the case that the long-term behavior of the 
homogeneous solution can be obtained from the poles of the transfer function. 
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| Example 5: | Consider 
(a) e"*, (b) eo * + e-*, (c) e'/®, (d) e~* sin(2t). 


We know that (a), (b), and (d) are solutions that decay to zero whereas (c) 
grows without bound. Moreover, we can observe that (d) converges to zero 
fastest, followed by (a) with (b) decaying slowest. Notice that it is the right- 


most root that determines the speed of the decay. - 


We can view an analogous example in the s-domain. 


| Example 6: | = Consider the transfer functions 


1 1 1 1 
Qs OGfDerD (4) 246s 418 


5s —1? 
from four different forced ODEs with rest initial conditions. Determine the 
long-term behavior of the solutions in the t-domain. For those that will give 
solutions that decay, state which will decay the fastest. 


Solution 

The poles of these functions are the same roots of the characteristic equation 
that gave rise to the functions in Example 5. Thus, (a) has a pole at s = —2, 
(b) at s = —1,—4, (c) at s = 4, and (d) at s = —3 + 2i. Our conclusions are 
the same as in Example 5. 


Notice that it is only the real part of the pole that will affect the behavior 
of the solution of the homogeneous system. We can state this succinctly as 
follows. 


THEOREM 7.5.1 

Consider the reduced form of the complex-valued transfer function H(s) 
defined in (7.37). If Re(s;) < 0 for every pole s;, then the solution x(t) 
for the homogeneous equation (i.e., f(t) = 0 in (7.34)) in the t-domain 
decays exponentially to zero as t + oo. If Re(s;) > 0 for at least one pole 
s;, then the solution x(t) for the homogeneous equation in the t-domain 
grows exponentially as t + oo. If any poles of H(s) satisfy Im(s;) 4 0, 
then the solution x(t) will have oscillatory motion. 


Although we began with the mass-spring system as our motivational exam- 
ple, the LRC circuit is of a similar form 


@I idl 1 ’ 
qa hol ae: 


where L is the inductance, R is the resistance, C is the capacitance, Q is the 


charge, I = 42 is the current, and € is the input voltage. Engineers use things 
8 dt g & 


1 
ae =E€ or equivalently L 
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such as oscilloscopes to measure the amplitude and frequency of a signal and 
then use this information to help determine the characteristics of the electric 
circuit. It is also common in physical applications to create a Bode plot 
which is simply a graph of the magnitude of the gain plotted as a function 
of the frequency (magnitude Bode plot) or the phase of the gain plotted as a 
function of the frequency (phase Bode plot). 


We finish with an example of the pole-zero plot of a transfer function. This 
is a convenient way to graphically see the zeros and poles of a given differen- 
tial equation. 


| Example 7: For the ODE (D?+3D+2)(D?+4D+5)(r) = E” +4E, find 


(a) the transfer function and (b) the forcing function that will not have any 
effect on the system. Then (c) draw the location of these poles in the complex 
plane and use this to determine the long-term behavior in the t-domain. 


Solution 

The tension finotion iy A= ve th venssat 
(a) The transfer function is H(s) = (s? 4354 2)(82 4 654 10) with zeros 
s = +27 and poles at s = —1,—2,-3+7%. (b) From the zeros of H(s), the 
forcing function e? will not have an effect on the system. In other words, 
any forcing of the form Asin 2¢ + Bcos2t for constants A, B will not affect 
the sytem. (c) The pole-zero plot is given below; since the poles all satisfy 
Re(s) < 0, the solutions in the t-domain will decay to zero. 


Im 


2i 


FIGURE 7.8: The locations of the zeros and poles in the complex plane for 
the transfer function in Example 7. The poles, marked as a blue x, correspond 
to a solution that will decay. The black 0 are the zeros and give the roots of 
forcing functions that will not affect the system. = 


Problems 


In Problems 1-8, determine the poles and zeros of the rational complex-valued 
functions. 


3 WT s+2 s+2 
3. —— 4, ———_ 
s—A s—T s2+4 s2—A4 
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s+2 s s+3 s—1l 
"62413542 “s24+45+4 “5242542 “s2+45+5 


In Problems 9-14, find the transfer function for the following forced differen- 
tial equations where the initial state of each is from rest. 

9.0" 4+32'4+4¢ =2E"+E'+E 10.0” +4¢7+5= E' +32E 

11.1" +4 +13l = Eh" +E 12.7" +21 +171 = E” 

13. RCQ'+Q=E 14. LI'+RI=E 


In Problems 15-24, compute the transfer function of the given ODE, where 
E = E(t). Use the poles in the complex plane to determine the long-term 
behavior of the solution of the original ODE in the t-domain. Assume “from 
rest” initial conditions. 


15.0”"+9% =E 16. 2” +102’ + 252 = 3E 

17.0" 4+30' +27 =2E'+E 18.0" +52’ +62#=E"+# 

19.2” + 4c = EB" —4E 20.0”. +a2=E"4+2F'+E 
21.2074+2¢' +22 = EE" -—E 22.0” +40’ +52 = B"+4E'+4E 


23. (D? + 2D'+ 9)(D? — 1\(2) = BE" —2E” 
24. (D? +4D +5)(D? —2D +3)(x) = E” — E’ 


In Problems 25-32, suppose the transfer function of an ODE results in the 
given function. (a) Draw the pole-zero plots in the complex plane. Determine 
(b) the long-term behavior of the solution in the t-domain and (c) the forcing 
functions that will have no effect on the system. 


25. 6, ne 

s(s? + 4) (s — 3)(s— 1) s? + 45 + 13 s? + 25+ 10 
s?—1 6s stl s 

9, ——___— 30. —~—_— 31. ———_———_ __ 332. —_—.—_—_ 

(s? +1) (s2 +9)? (s+12+4 (s+2)243 


In Problems 33-36, obtain the frequency-response function in the following 
manner: (a) find the transfer function for the forced differential equations as 
given where the initial state of each is from rest; (b) then substitute s = iw. 
Compare with Equation (4.74) and Problems 13 and 14 in Section 4.7. 

33. 2" + uz! +w2x2 = 2B 34.1" + 2+ 41=2E 

35. ma” + ba! + kx = bE’ 36. ma" 4+ ba! +ka = bE" +kE 


7.6 Solving Linear Systems Using Laplace Transforms 


We can apply the Laplace transform method to find the solution of a first- 
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order system 


dx d 
a1 + a2 t + a3x + aay = Bi (t) 
dx dy _ 
by dt T by ae + b3x T bay = Bo(t) (7.38) 


where @1, @2, 23, @4, 01, be, b3, and b4 are constants and ((t), 82(t) are known 
functions. In addition, x and y satisfy the initial conditions 


x(0)=c, and y(0)= co 


where c; and cg are constants. 
The procedure we employ is a straightforward extension of the method we 
used to solve an ordinary differential equation. Letting 


X(s)=L{x(t)} and Y(s) = Lty(t)} 


we apply the Laplace transform to Equation (7.38) to obtain a system of 
algebraic equations in X(s) and Y(s). This system of algebraic equations is 
then solved for X(s),Y(s). Once these are obtained, we find (if possible) 


x(t) =L-{X(s)} and y(t) = L-'{¥(s)}. 


/Example 1:| Use Laplace transforms to solve the system 


d. 
=, ~ bt + 3y = 8el 


dy 
dt 
that satisfies the initial conditions x(0) = —1, y(0) = 0. 


— 22 —y = 4e® 


Solution 
Applying the Laplace transform to both sides of the system gives 


iS { a ~ 6£ {a(t)} + 3L {y(t)} = Lf8er} 


dy 


£{ Eh — acfe(o} — ctu(o)} = ct4e') 


and letting X(s) = £{a(t)} and Y(s) = L{y(t)} gives 


fe {=} = sX(s)—2(0) =sX(s)+1 


£{ Bh = sy (s)~ (0) =s¥(). 
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So, using the Laplace transform table, we have 


sX(s) +1 6X(s) + ¥(s) = ~ = : 
s¥(s)—2X(s)— V(s) = = - 
which simplifies to 
(5 — 6)X(s) +3¥(s) = =" 
~2X(s) + (@-1)¥(s) = — 


Now solving this system of algebraic equations for X(s) and Y(s) gives 


oe. sat pn 
*9=Gone-gH mt YO=Grpe-D 
Thus 
and 


ee) oa \wane=aJ | 


Applying partial fractions we have 


—s+7 A B 
(s—1)(s—4) s—-1 ° s—4 


which gives A = —2 and B = 1, so 


v(t) =-2e-{ oh | crf}. 


Using the Laplace transform table, we find a(t) as 


a(t) = —2e’ + e*# 


and in a very similar manner, we find y(t) as 
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| Example 2:| Solve the system 


ze =—x+y+25sint 
y = —a — 3y 


with the initial conditions (0) = —1,y(0) = —1. 


Solution 
If we take the Laplace transform of both sides of this system we obtain 


L{ax'} = —L{x} + L{y} + 25L {sin t} 
L{y'} = —L{x} — 3L{y}. 
Letting X(s) = £{a(t)} and Y(s) = L{y(t)}, then this becomes 


25 
s?t+1 


sX(s)+1=—X(s)+Y(s) + 

sY(s) +1 = —X(s) — 3Y(s). 

Solving these linear equations for X(s) and Y(s) gives 
X(s) =—(3+8)Y(s)-1 


and 
s 25 


(s +2)? (s+2)?(s?+1)° 
Now applying partial fractions to the second term here, 


25 A. 4 B Cs+D 


Y(s) = 


(s+2)2(s?4+1) s+2- Gane” (s? +1)’ 


gives 


A+C=0 
2A4+B+4C+D=0 
A+4C0+4D=0 
2A+B+4D =25. 


Solving this system gives A= 4, B=5, C = —4, and D =3. 
Thus 


- 25 
e { (s + 2)?(s? + 1) 


Combining the above yields the explicit form of the solution as 


\ = de~*" + 5te~7" — Acost + 3sint. 


y(t) = —e~**(3t + 5) + 4cost — 3sint. 
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We find x(t) by solving y’ = —a — 3y for x as 


a(t) = —3y—y' 
so that 
a(t) = e **(3t + 8) — 9cost + 13sint. 
|_| 
e@ e e e e e e e e e@ e e 
Problems 


In each of the following Problems 1-12, use the Laplace transform to find the 
solution of the linear system that satisfies the given initial conditions. Assume 


c= a(t), y=y(t). 


x’ —2y =0 5 x’ +y = 3e 
y +a —3y=2 y +x=0 
2(0) = 3, (0) =0 #(0) =2, y(0)=0 


x’ — 2x2 —3y =0 
y t+x2+2y=t 
(0) =—1, y(0) =0 


x’ — 4a + Qy = 2t 
y —84+4y=1 
x(0) = 3, y(0) =5 


y’ —4a+y=0 
«(0) = 3, y(0) =0 «(0) = 3, y(0) =2 
Qe’ +y' +a 4+ 5y = 4t 
xv +y'+2x4+2y=2 
(0) =3, y(0) =—4 


x+y +2Qe+y=e! 
(0) =2, (0) =1 


a’ — 5a + 2y = 3e* é | a’ +a+y=5er 


2a’ —-2Qa+y'=1 x’ +2¢+y' = 16e~-% 


| 
| 
| 


x —3x+y! —3y' =2 . Qe’ + 3y' + 5y = 15 
"4.29 — dy’ =0 
az’ —y! =e x 7 
11. ia ere 12. “= ee 
13. (a) Letting, as usual, X(s) = £{a(t)} and Y(s a2 — Lly(dh the Laplace 
! _— = 
transform converts the initial-value problem i. ao a 2 f 
g+y =t 
; 7 ais sX +(s—lY fe os 
with (0) = 1 and y(0) = 0 into the system 3X : “v= =1423 
(b) Solve the system in part (a) for Y(s) as Y(s) = Then use 


ween 1) 
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partial fractions and the inverse Laplace transform to show that y(t) = 
5 — 5t + 2t? — 5e*. 
(c) Show that X(s) + Y(s) = ++ and solve for a(t). 


7.7 The Convolution 


Sometimes inverse Laplace transforms and the use of the table of transforms 
can be simplified by using the convolution theorem that we give below. We 
first define the convolution of two functions f and g. 


Definition 7.7.1 

Let f and g be two functions that are piecewise continuous on every finite 
closed interval 0 < t < b and of exponential order. The function denoted 
by f * g and defined by 


f(t) * g(t) = io f(r)g(t — 1) dr (7.39) 


is called the convolution of the functions f and g. 


The convolution operation * is commutative, that is, f * g = g * f. To see 
this, we need only change variables in (7.39). Letting u = t—7, we have 
t 


fl *9(t) = f° Healt n)ar 


= g(t) * f(t). 


| Example 1:| Let f(t) =e~™ and g(t) = sinbt. Then we have 


t 


f(t)*g() = | e “7 sin b(t — 7) dr 


l 
i ec Ut-7) gin bt dr (using fxg = g* f) 


t 
ew f e sin br dr 


1 
= 5 yg in bt = bcos bt + he |, 
a +5 ial 


We now state a useful fact about the convolution of two functions f and g. 
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PROPOSITION 7.7.1 

If the functions f and g are piecewise continuous on a closed interval 
0 < t < b and of exponential order e“’, then the convolution f * g is 
also piecewise continuous on every finite closed interval 0 < t < b and of 
exponential order e(¢+©)t where ¢ > 0 is a constant. 


We will not prove this proposition, but we note here that it guarantees the 
existence of L{f * g} when L{f} and L{g} exist. 


THEOREM 7.7.1 Convolution 
If f and g are piecewise continuous functions on every closed interval 
0 <t <b and are of exponential order e* then 


L{f xg} =L{fIL{g} 


for s >a. 


Proof: Applying the definition of the Laplace transform, L{f * g} is the 
function defined by 


i a | f(r)g(t — 7) dr| dt 


which can be written as 


[ ‘i e §* f(r)g(t — T) dr dt. 


Now consider the region R, shown in Figure 7.9. 
t 


Ry 


FIGURE 7.9: Region of integration R,. 


Thus 
[ [ e * f(r)g(t — 7) arat= ff e~** f(r) g(t — 7) dr dt. 


So if we consider the change of variables u = t —T,v = 7, which has Jacobian 
1, the double integral over R, becomes the double integral 


| l. e F) Fv) g(u) du dv 
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where Rz is the quarter plane defined by u > 0,v > 0 shown in Figure 7.10. 


UV 


Ro 


FIGURE 7.10: Region of integration Ro. 


We then have 


Ile e840) #4) g(u)dudv= ff e+”) F(y)g(u) du dv 
=i em go)dv f ag luhdu. 


Indeed, since the integrals involved in this calculation are absolutely conver- 
gent for s > a, the operations we performed above are valid so we have shown 


L{fegh} =L{filL{g} fors>a. i 


If we denote L{f} by F and L{g} by G then the conclusion of the last 
theorem can be written as 


Li f(t) * g(t)} = F(s)G(s). 


Thus, 
£-{F(s)G(s)} = f(t) o=[ f(rjg(t—n)d (7.40) 


and since « is a commutative operation, we have 


t 

L-"{F(s)G(s)} = g(t) * f(t) = [ g(r) f(t — 7) dr. (7.41) 
These remarks allow another method for computing inverse Laplace trans- 
forms. Suppose we are given a function H and need to find L~!{H(s)}. If 
we can express H(s) as a product F(s)G(s) where L~'{F(s)} = f(t) and 
L~'{G(s)} = g(t) are known, then we can apply (7.40) or (7.41) to determine 


LM H(s)}. 


|Example 2:1 Find £7 fs z iy using the convolution and the transform 


table. 
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Solution 
Writing WT as the product F'(s)G(s) where 


sO 


or 


* army} = g(t) * f(t) = [ snr. 1dr. 


Here the second integral is (slightly) more simple to evaluate, so we have 


= 1 _ 
L fy =1- cost. 


Note that we obtained this result earlier by means of a partial fractions de- 
composition. 


| Example 3:| Newton’s Law of Cooling (revisited) 


Solution 
Recall from Chapter 1 we considered Newton’s Law of Cooling: 


dT 
= =k) - T.(0)), 
which says that the rate of change of the temperature T(t) of a body is 
proportional to the difference between the temperature of the body and its 
surroundings T,(t). Unlike our work in Chapter 1, here we assume T, is not 
necessarily a constant. So, applying the Laplace transform to both sides of 
this differential equation gives 


z {or} = £{k{T(t) — T.(t)]} 


which is 
sL{T} — T(0-) = kL{T} — kL{T.}. 
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Solving this equation for £L{T} gives 


T (07 k; 
Pye = ey 
s—-k s—k 
Using the convolution theorem we find the inverse Laplace transform as 


t 
T(t) =T(0-)e — if kT, (2)e"?-* dz, 
that is, t 
T(t) =T(0 je — best f Telzje™ dz. (7.42) 
Equation (7.42) is the solution of Newton’s Law of Cooling with a nonconstant 
surrounding temperature. If we take T,(t) = T, a constant, as we did in 
Chapter 1, then Equation (7.42) becomes 


which is the solution we obtained in Chapter 1; see Equation (1.4). - 


Although the idealized unit impulse is not a piecewise continuous function 
and thus doesn’t satisfy the criteria of Theorem 7.7.1, there is a comparable 
Theorem addressing the convolution of generalized functions. Based on this, 
we state two convolution results here that may be of interest. 


Consider the idealized unit impulse function given in Definition 7.1.2. 
Then the following convolution results hold: 


MOG = ie ee (7.43) 


t—a), t>a 


SCO Oe Ae fae on (7.44) 


If we apply the formula from Theorem 7.7.1 or Definition 7.7.1, this should 
be believable and we refer the interested reader to [36] for further discussion. 
e e e e e e e e e e e e 


Problems 


In each of the following Problems 1-6, compute the convolution (f * g)(t) for 
the given pair of functions. 
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Find f(t) = £~'{F(s)} using the convolution theorem for each of the func- 
tions F(s) in Problems 7-12. 


1 iL 
C= aa cane Ee ake Tm | 
2 10. F(s) = : 
a ~ s(s2 +9) ea ~ g(s? + 4g +13) 
1 1 
11. F —— 12. F = 
©) = 36 +3) ©) = a DEFD 


13. Show that the convolution operation * is associative; that is 


(Ff * (g * h))(t) = (fF #9) *h)) 


for functions f, g, and h. 


14. Show that the convolution operation * satisfies the distributive prop- 
erty over addition; that is, 


(f*(g+h))(t) = (f* g(t) + (F * AYE) 


for functions f, g, and h. 
15. Show that for any constant k, ((kf) * g)(t) = k(f * g)(#). 
16. Show that t-1/? «t—/? = 7. Hint: Find £L{t7/?}. 
17. Compute for a constant k 

(a) sin kt * cos kt (b) sin kt « sin kt (c) cos kt « cos kt 


(d) Using the results, compute £~+ { tee} . 
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In Problems 1-6, determine whether the statement is true or false. If it is 
true, give reasons for your answer. If it is false, give a counterexample or 
other explanation of why it is false. 


1. For any function f(t), the Laplace transform L{f(t)} exists. 


2. L{Ci fi(t) + Co fo(t)} = CiL{fi(t)}CoLlt{ fo(t)}. 
3. The translated function [U,(t)f(t — a) = Pea) i <@ has 


Laplace transform L{U,(t) f(t — a)} =e“ L{ f(t}. 
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4. If L{f(t)} = F(s) exists for some s > a for a function f(t) in which 
f(t)/t is bounded for t > 0, then L {rr} = / F(z) dz. 


5. If L{f(t)} = L{g(t)}, then f(t) = g(t) for all t > 0. 


6. The poles in the s-domain of the Laplace transformed ODE determine 
the long-term behavior of the system in the t-domain. 


In Problems 7-12, use the definition of the Laplace transform to find L{ f(t)} 
for each of the given functions f(t). 

T7020 8. f(t) = 5U2(t) 9.70) =o 

10. f(t) = |t-2| Life 12. f(t) =e’ cost 


In Problems 13-18, use the definition of the Laplace transform, Theorems in 
the chapter, or other techniques (but not Table 7.1) to find £{f(t)} for each 
of the given functions f(t). 


13. f(t) = cosh bt 14. f(t) =e" cos bt 
15. f(t) = tsin bt 16. f(t) = tcos bt 

tsin bt in bt — bt bt 
17. f(t) = s 18. f(t) = — a se 
19. f(t) =t",n =1,2, 20. f(t) =t%e",n = 1,2, 


In Problems 21-24, evaluate the following integrals involving the Dirac delta 
function. 


21. foredse-9 dt 2. i (1+ e7*)d(t — 2) dt 
0 


—5 
= 2 
3 
23. / tan to(t — *) dt 24. / sin 2td(t) dt 
0 = 
In Problems 25-30, find the poles of the given complex-valued rational func- 


tion and use it to determine the long-term behavior of the solution in the 
t-domain. Then calculate £~'{F(s)}. 


7s 5 5s 
pes 
a ge, RE) ee Gi gaa 


In Problems 31-34, (a) compute the transfer function of the given ODE, 
where & = E(t), and then (b) graph the pole-zero plot. (c) State the long- 
term behavior of the ODE in the t-domain and state the forcing functions that 
will not have any effect on the system. Assume “from rest” initial conditions. 
31.0"+4+ 52’ +64=E 32. 0” + 3a’ + 2a = E’ 

33. (D? + 4D + 8)(D? +1)(x) =4E’ + 8E 

34. (D? +6D+4+13)(D+1)(2) = E"” +4E 


In Problems 35-44, use Laplace transforms to solve the initial-value problem. 


35. 
36. 
37. 
38. 
39. 
40. 
41. 
42. 
43. 
44. 


45. 


46. 


AT. 


48. 


49. 


50. 
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xz’ —g=e*, 2(0)=6 
x +9xr=0, x(0) =2 
vw’ +8lx=0, 2(0)=1, a (0)=2 


xv” —a'—122=0, «(0)=1, «’(0) =0 

vw" +22'+5y=0, «(0)=6, 2’(0) =0 

a! +42a'+e=te, 2(0)=1, 2'(0) =0 
a" — 8a’ + 152 = 5te**, 2(0)=5, 2/(0)=4 


x” — x! — 2x = 13e~' cos4t, x(0) =0, 2’(0) = 
x!” —7a' — 6a = 13t, «(0)=1, 2’(0) =2, 
xv” +3a’—-10r=e', x(0)=-1, v’(0)=1 


Suppose an insect pest population grows at a rate proportional to its size 
with rate r = 1/10 (per day). In an attempt to eliminate the pest, a 
farmer applies a pesticide. The pesticide kills the insect at a rate that, 
in one day, decreases linearly with time from the maximum rate P > 0 
to 0 (in units of 10,000 per day). As this is a rather potent pesticide, 
regulations allow the farmer to apply it only once. If the initial pest 
population is approximately 200,000 and the farmer applies a dosage 
P = 30, will the pest population be eliminated? 

A forced vibration of a mass m at the end of a vertical spring, with spring 
constant /& and no damping, is described by ma” (t)+ka(t) = f(t), where 


f@) =1+ 010) — 202). 


Solve this differential equation for m = 1,k = 8,2(0) = x'(0) = 0. Plot 
the solution on the interval 0 < t < 3 and discuss what you observe. 


Using the definition of the Laplace transform, show that 
Lilet — oe for s >a. 
s—(a+Di) 


Prove that if f and g are piecewise continuous on [a, b], then the product 
fg is piecewise continuous on [a, }}. 


The differential equation for the current I(t) in a series circuit with in- 
ductance L and resistance F is 


LI'+ RI = E(t) 


where E(t) is the applied voltage. If [(0) = 0 and Ep is a constant, solve 
this equation if 

(a) E(t) is the square pulse E(t) = Eo[Ui(t) — Uo(t)] 

(b) E(¢) is a single pulse of a sine wave E(t) = (sint)[Uo(t) — Ux (t)] 
The floor or unit staircase function is defined as 


f(it)=nifn-l<t<n, 
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for n a positive integer. Show that f(t) = sy U(t—k). Using this result, 


k=0 
and assuming that the Laplace transform exists for this infinite series, 


show using a geometric series that L{ f(t)} = eH 
s(l—e 


51. Using the method in Problem 50, show that the function 
f® => Cp ue - k) 
1 


s(l+e-%) 


52. Using Problem 51, show that the square wave function 


has Laplace transform L{ f(t)} = 


(t) = a n—-1<t<n,nan odd integer 
MI) B n-1<t<nnan even integer 
has Laplace transform L{ f(t)} = Bane 
s(1+e7*) 
In Problems 53-56, use Laplace transforms to solve the following initial-value 
problems. 

zg’ +2¢+y' = 8e—* 7 _ 
53. ce 3p! + By 12 with «(0) = 2,y(0) = —3 


re _— i 
sa. { ae ee Ol ad ed 


xv’ —3a+y' —3y=2 


q! — y! = —e2t . _ 7 
55. ae a with «(0) = —1,y(0) = —10 


1 9) — 5, 3t 


In Problems 57-60, compute the convolution (f * g)(t) for the given pair of 
functions. 


57. f(t) = 3, g(t) 


= 58. ff) =snsig)=<e" 
59. f(t) = 244, g(t) = 


cos 4t 60. f(t) = cost, g(t) = 6 (t— §) 


In Problems 61-65, use the convolution to find £~'{F(t)}. 


1 1 1 


61. F(s) = ————_- 62. F(s) = ———_- 68. F'(s) = —~—~ 
(s) s*+7s+12 (s) s? + 3s — 40 (s) s(s? +4) 
il 


64. F(s) = 65. F(s) = 


52(s? + 36) (s? + 64)(s + 8) 
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Chapter 7 Computer Labs 


Chapter 7 Computer Lab: MATLAB 


MATLAB Example 1: Enter the code below to find, using Symbolic Math 


Toolbox, some basic Laplace transforms and inverse Laplace transforms. 


= 
= 
oe 
Ze 
SE 
= 
= 
= 
= 
oe 
= 
= 


clleanmalilt 

syms s tab 

eqi=laplace(1,t,s) “Laplace transform of 1 
eq2=laplace(sin(b*t) ,t,s) 

f1=t*cos(b*t) 

eq3=laplace(f1,t,s) 

f2=exp(-a*t) *sin(b*t) 

eq4=laplace(f2,t,s) 

g1=1/(s*2+6*s+13) 

eq5=ilaplace(gi,s,t) Zinverse Laplace transform 
g2=exp (-4*s) *(2/s%2+5/s) 
eq6=ilaplace(g2,s,t) 


MATLAB Example 2: Enter the code below to find, using Symbolic Math 


Toolbox, the Laplace transforms and inverse Laplace transforms or the unit 
step (Heaviside) function and idealized impulse (delta) function. 


LE 
= 
= 
=> 
= 
= 
= 
= 
oe 
= 
= 
Ze 
oe 
= 


clear all 

syms s t ab 

f1=dirac(t-3) 

eqO=int(f1,t,-inf,inf) %must be 1 by definition 
eqi=laplace(f1,t,s) 

eq2=ilaplace(eqi,s,t) 

f2=heaviside(t) 

eq3=diff (f2,t) 

eq4=int (f2,t) 

eq5=laplace(f2,t,s) 

eq6=ilaplace(eq5,s,t) 

£3=(2*t-3) *heaviside(t-4) “Heaviside function 
eq7=laplace(f3,t,s) 

eq8=ilaplace(eq7,s,t) 


MATLAB Example 3: Enter the code below, using Symbolic Math Toolboz, 
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to calculate the frequency response function of the given differential equation 
via its transfer function given in (7.36)-(7.37). 

2 

= + Quin + ore = a 

>> clear all 
>> syms zeta wn FO m s omega 
>> zeta=sym(’zeta’,’real’) 
>> zeta=sym(’zeta’,’ positive’) 
>> omega=sym(’ omega’, ’real’) 
>> omega=sym(’ omega’, positive’) 
>> wn=sym(wn,’real’) 
>> wn=sym(wn,’positive’ ) 
>> FO0=sym(FO,’real’) 
>> F0=sym(FO,’positive’ ) 
>> m=sym(m,’real’) 
>> m=sym(n,’positive’) 
>> observe bi=FO/m 
>> H=(F0*s/m)/(s2+2*zeta*wn*stwn’ 2) 
>> g=subs(H,s,ixomega) 
>> sqrt (simplify (g*conj(g))) 


MATLAB Example 4: Enter the code below, using Symbolic Math 
Toolbox, to determine the long-term behavior of the solution of 
(D? + 3D + 4)(D? + 7D + 2)\(z) = E'+ E using the location of the 
poles of its transfer function. 

= clican sala! 

>> syms s 

>> P=(s2+3+s+4) *(s2+7*s+2) 

>> H=(s+1)/P 

>> sol=solve(P,s) 

>> eval(sol) 


MATLAB Example 5: Enter the code below, using Symbolic Math Toolboz, 
to calculate the convolution and see the relation with Laplace transforms. 
>> clear all 

>> syms s t ab tau 

>> gl=1/(s*2*(s*2+1)) 

>> eqi=ilaplace(gi,s,t) 

>> eq2=int(tauxsin(t-tau),tau,0,t) using convolution 

>> f1=exp(-a*tau)*sin(b*(t-tau) ) 

>> eq3=int(f1,tau,0,t) 

>> simplify (laplace(eq3,t,s)) 


Chapter 7 Computer Labs 569 


MATLAB Exercises 

Turn in both the commands that you enter for the exercises below as well as 
the output/figures. These should all be in one document. Please highlight or 
clearly indicate all requested answers. Some of the questions will require you 
to modify the above MATLAB code to answer them. 


il. 


. Find the Laplace transform o 


. Find the Laplace transform of e 


. Find the inverse Laplace transform of rae 


. Find the inverse Laplace transform of e~*(s 


. Find the inverse Laplace transform of — 


Enter the commands given in MATLAB Example 1 and submit both your 
input and output. 


. Enter the commands given in MATLAB Example 2 and submit both your 


input and output. 


. Enter the commands given in MATLAB Example 3 and submit both your 


input and output. 


. Enter the commands given in MATLAB Example 4 and submit both your 


input and output. 


. Enter the commands given in MATLAB Example 5 and submit both your 


input and output. 


. Find the Laplace transform of cost. 
. Find the Laplace transform of sin 5t. 
. Find the Laplace transform of t sin 5t. 


f sin bt—bt cos bt 
263 


. Find the Laplace transform of e* cos 4t. 


= 2b stn Bye 


. Find the Laplace transform of Int. 

. Find the Laplace transform of 6(t — 1). 

. Find the Laplace transform of td(t — 2). 

. Find the Laplace transform of Uo(t). 

. Find the Laplace transform of tU;(t). 

. Find the inverse Laplace transform of s?. 

. Find the inverse Laplace transform of s* — 3. 


. Find the inverse Laplace transform of GP 
. Find the inverse Laplace transform of = — 


. Find the inverse Laplace transform of e~* — 


8 
2 

Gwe 
3 


3 
ea) 


. Find the inverse Laplace transform of e~?° [ostr — 3) : 


y+ln s 
Saar eee 
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26. 


Die 


28. 


2). 


30. 


ole 


32. 


33. 


34. 


35. 


36. 


37. 


38. 
39. 
AO. 
Al. 
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Use the transfer function to calculate the frequency response function of 
e+e +a= E+E. 
U 


i 

se the transfer function to calculate the frequency response function of 
vw’ +52'+102 = 2b" + E&E. 
i 


Use the transfer function to calculate the frequency response function of 
ve! +4e' +a = EH’. 

Use the transfer function to calculate the frequency response function of 
"4 Qo! + 20 = EB! + 3. 

Use the transfer function to calculate the frequency response function of 
(D? + 2D + 1)(D? +6D + 10)(x2) = EF” +2E. 

Use the transfer function to calculate the frequency response function of 
(D? + 2D + 2)(D? + 10D + 29)(x%) = FE!” + E". 

Use the poles of the transfer function to determine the long-term behavior 
of solutions of w” + 20’ + a= E’ + E. 


Use the poles of the transfer function to determine the long-term behavior 
of solutions of 7” + 5a’ + 10” = 2E” + E. 


Use the poles of the transfer function to determine the long-term behavior 
of solutions of 4a” + 4a’ + 4 = E’. 


Use the poles of the transfer function to determine the long-term behavior 
of solutions of x” + 2a’ + 24 = E’ + 3E. 


Use the poles of the transfer function to determine the long-term behavior 
of solutions of (D? + 2D +1)(D? +6D+10)(x) = EB!" +2E. 


Use the poles of the transfer function to determine the long-term behavior 
of solutions of (D? + 2D + 2)(D? + 10D + 29)(x) = FE” + E”. 


se the definition of the convolution, (7.39), to find ¢ * sin(t). 


se the definition of the convolution, (7.39), to find cost x sin(t). 
se the definition of the convolution, (7.39), to find 6(t) * cos(t). 
se the definition of the convolution, (7.39), to find Uo(t) * e’. 


U 
U 
U 
U 
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Maple Example 1: Enter the code below to find some basic Laplace 


transforms and inverse Laplace transforms. 


restart 
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with( inttrans) 
eq1 := laplace(1, t, s) 
eq2 := laplace(sin(b - t), t, s) 
fl :=t-cos(b- t) 
eq3 := laplace(f1,t, s) 
f2:= en" -sin(b- 4) 
eq4 := laplace(f2,t, s) 
1 


1 ——————— 
| © aeoneats 
eqd := invlaplace(g1, s,t) 
2 
g2 = e *s lies at, = 
8 S 


eq6 := invlaplace(g2, s,t) 
convert( eq6, ’ piecewise’) 


Maple Example 2: Enter the code below to find the Laplace transforms 
and inverse Laplace transforms or the unit step (Heaviside) function and 
idealized impulse (delta) function. 


restart 

with( inttrans) 

fi := Dirac(¢ — 3) 
CO 


cao:= | fi dt 
eal = laplace( 1, t, 8) 


eq2 := invlaplace(eq1, s, t) 
f2 := Heaviside(t) 


Ca — fe dt 


eqd := laplace(f2,t, s) 

eq6 := invlaplace(eq5, s, t) 

f3 := (2-t — 3) - Heaviside(t — 4) 
eq7 := laplace(f, t, s) 

eg8 := invlaplace(eq7, s, t) 


Maple Example 3: Enter the code below to calculate the frequency response 
function of the given differential equation via its transfer function given in 
(7.36)-(7.37). 


a d. wa 
eee one eg = ——B 
dt m 


restart 
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Fo 
— s§ 
= m 
(s? + 2- zeta: wn-s + wn?) 
g := subs(s = I-w, H) 
gabs := simplify(evalc( abs(g))) 


Maple Example 4: Enter the code below to determine the long-term 
behavior of the solution of (D? + 3D + 4)(D? + 7D + 2)(x) = E’ + E using 
the location of the poles of its transfer function. 


restart 
s+1 


~ (s?-+3-84+4)-(s?+7-5s+2) 
solve(numer(H), s) 
sol := solve(denom(H), s) 
evalf( sol) 


Maple Example 5: Enter the code below to calculate the convolution and 
see the relation with Laplace transforms. 


restart 
with( inttrans) 


L3= So 
Z s?-(s% +1) 
eq1 := invlaplace(g1, s, t) 
t 
Cie = I 7-sin(t— 7) dr 
0 
fl :=e—-a-7-sin(b: (¢—7)) 
t 
Cis = | semen 
0 
laplace(eq8, t, s) 
Maple Exercises 
Turn in both the commands that you enter for the exercises below as well as 
the output/figures. These should all be in one document. Please highlight or 


clearly indicate all requested answers. Some of the questions will require you 
to modify the above Maple code to answer them. 


1. Enter the commands given in Maple Example 1 and submit both your 
input and output. 


2. Enter the commands given in Maple Example 2 and submit both your 
input and output. 


. Find the Laplace transform of e 


. Find the inverse Laplace transform of s? — oc 


. Find the inverse Laplace transform of sa 


. Find the inverse Laplace transform of — 
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. Enter the commands given in Maple Example 3 and submit both your 


input and output. 


. Enter the commands given in Maple Example 4 and submit both your 


input and output. 


. Enter the commands given in Maple Example 5 and submit both your 


input and output. 


. Find the Laplace transform of cost. 

. Find the Laplace transform of sin 5t. 

. Find the Laplace transform of t sin 5t. 

. Find the Laplace transform of sin bh pcos bt 


. Find the Laplace transform of e* cos 4t. 


2 stir BYE. 


. Find the Laplace transform of Int. 

. Find the Laplace transform of 5(t — 1). 

. Find the Laplace transform of té(t — 2). 
. Find the Laplace transform of Uo(t). 

. Find the Laplace transform of tU;(t). 

. Find the inverse Laplace transform of s?. 


3 


Ss 


. Find the inverse Laplace transform of (SEE BE)E 


. Find the inverse Laplace transform of xe _ S. 
. Find the inverse Laplace transform of e~* — =. 
. Find the inverse Laplace transform of e~*(s — a De 


. Find the inverse Laplace transform of e~ 7° i — 4) : 


y+ln s 
Sooper ae 


se the transfer function to calculate the frequency response function of 
"19¢'+a= E+E. 


Wo 5a! + 102 = 2h" + BH. 


se the transfer function to calculate the frequency response function of 
Alig Me Alyy Ae apes 105 


U 
ie 
. Use the transfer function to calculate the frequency response function of 
at 
U 


. Use the transfer function to calculate the frequency response function of 


G27 227 = a3 Bh 


. Use the transfer function to calculate the frequency response function of 


(D? + 2D +1)(D? + 6D + 10)(x) = E’” + 2E. 
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31. Use the transfer function to calculate the frequency response function of 
(D? + 2D + 2)(D? + 10D + 29)(x) = EF” + BE". 

32. Use the poles of the transfer function to determine the long-term behavior 
of solutions of 2” + 22/ +a2= E' +E. 
33. Use the poles of the transfer function to determine the long-term behavior 
of solutions of x” + 52’ + 102 = 2H” + E. 
34. Use the poles of the transfer function to determine the long-term behavior 
of solutions of 42” + 4a’ +a = E’. 
35. Use the poles of the transfer function to determine the long-term behavior 
of solutions of x” + 2a’ + 27 = E’ + 3E. 
36. Use the poles of the transfer function to determine the long-term behavior 
of solutions of (D? + 2D + 1)(D?+6D+10)(x) = EB!” +2E. 


37. Use the poles of the transfer function to determine the long-term behavior 
of solutions of (D? + 2D + 2)(D? + 10D + 29)(x) = E’” + E”. 


38. Use the definition of the convolution, (7.39), to find ¢ * sin(t). 
39. Use the definition of the convolution, (7.39), to find cost x sin(t). 
40. Use the definition of the convolution, (7.39), to find 6(t) * cos(t). 
41. Use the definition of the convolution, (7.39), to find Uo(t) * et. 
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Mathematica Example 1: Enter the code below to find some basic Laplace 
transforms and inverse Laplace transforms. 


Quit[] 

eqi = LaplaceTransform[1, t, s] 

eq2 = LaplaceTransform[Sin[bt], t, s] 
viklle_]) = wCos [lore 

eq3 = LaplaceTransform[fi[t], t, s] 
f2Qte_]] = o-@*’ Siim[loel 

eq4 = LaplaceTransform[f2[t], t, s] 


giles) = mesrais 
Saoposea lo 
eq5 = InverseLaplaceTransform[gils], s, t] 
FullSimplify [eq5] 
2 5 
e2lso) vem! ( +2) 


es 


Chapter 7 Computer Labs 575 


eq6 = InverseLaplaceTransform[g2[s], s, t] 


Mathematica Example 2: Enter the code below to find the Laplace 
transforms and inverse Laplace transforms or the unit step (Heaviside) 
function and idealized impulse (delta) function. 


Quit[] 
fi[t_] = DiracDelta[t - 3] 


eqOd filt]dt (*entered from the palette*) 


=e.) 
eqi = LaplaceTransform[f1[t], t, s] 
eq2 = InverseLaplaceTransform[eqi, s, t] 
f£2[t_] = UnitStep[t] 


eq3 = £2’([t] 
eq4 = f2[t]dt 
eq5 = LaplaceTransform[f2[t], t, s] 


eq6 = InverseLaplaceTransform[eq5, s, t] 
£3[t_] = (2t - 3) UnitStep[t - 4] 

eq7 = LaplaceTransform[f3[t], t, s] 

eq8 = InverseLaplaceTransform[eq7, s, t] 


Mathematica Example 3: Enter the code below to calculate the frequency 
response function of the given differential equation via its transfer function 
given in (7.36)-(7.37). 


da dx 2 Fo 
es a Seo 
dt Bae m 


Quit|] 


H[s_] = a 
a s?+ 2zetawns + wn? 
g = ReplaceAll[H[s], s>iw] (*i entered from palette*) 


gabs = ComplexExpand [Abs [g] ] 


Mathematica Example 4: Enter the code below to determine the long- 
term behavior of the solution of (D? + 3D + 4)(D? + 7D + 2)(z) = E' +E 
using the location of the poles of its transfer function. 


Quit[] , 

Sr 
poole oRnsean ae MT aee) 
Solve [Numerator [H[s]]==0, s] 


sol = Solve[Denominator[H[s]]==0, s] 
N[sol] 
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Mathematica Example 5: Enter the code below to calculate the convolu- 
tion and see the relation with Laplace transforms. 
Quit[] 
il 
1 = ee 
gt{s_] s?(s? + 1) 
eqi = InverseLaplaceTransform[gils], s, t] 


iG 
| -Sintt — 7ld7 
Pilea] ste °7 Stal (cry 
i 


eq2 


eq3[t_] = ‘| steal Cla 
0 
FullSimplify[LaplaceTransform[eq3[t], t, s]] 


Mathematica Exercises 

Turn in both the commands that you enter for the exercises below as well as 
the output/figures. These should all be in one document. Please highlight or 
clearly indicate all requested answers. Some of the questions will require you 
to modify the above Mathematica code to answer them. 


1. Enter the commands given in Mathematica Example 1 and submit both 
your input and output. 


2. Enter the commands given in Mathematica Example 2 and submit both 
your input and output. 


3. Enter the commands given in Mathematica Example 3 and submit both 
your input and output. 


4. Enter the commands given in Mathematica Example 4 and submit both 
your input and output. 


5. Enter the commands given in Mathematica Example 5 and submit both 
your input and output. 

Find the Laplace transform of cost. 

Find the Laplace transform of sin 5t. 

Find the Laplace transform of ¢ sin 5t. 

Find the Laplace transform of ey ee 
10. Find the Laplace transform of e** cos 4¢t. 

11. Find the Laplace transform of e~* sin 3t. 
12. Find the Laplace transform of Int. 

13. Find the Laplace transform of 5(t — 1). 

14. Find the Laplace transform of td(t — 2). 

15. Find the Laplace transform of Uo(t). 

16. Find the Laplace transform of tU;(t). 


if, 
18. 


i), 
20. 
ZL, 


22e 
Pe 


24. 


25. 
AAG. 


ie 


28: 


29). 


30. 


3l. 


32. 


33. 


34. 


35. 


36. 


of. 


38. 
39. 
40. 
Al. 
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Find the inverse Laplace transform of s?. 


Find the inverse Laplace transform of s* — +. 


Find the inverse Laplace transform of aan. 


Find the inverse Laplace transform of (EEE: 


Find the inverse Laplace transform of a —— 


g2 
Find the inverse Laplace transform of e~* — =. 
Find the inverse Laplace transform of e~*(s — os Me 


Find the inverse Laplace transform of e~?° [a — 3) : 


Find the inverse Laplace transform of — Tins, 
se the transfer function to calculate the frequency response function of 
"190'+a= E+E. 


U 
ae 
Use the transfer function to calculate the frequency response function of 
a 
U 


"4+ 50/ + 102 = 2H” + E. 
se the transfer function to calculate the frequency response function of 


Use the transfer function to calculate the frequency response function of 
xv +2a' +22 = E' + 3E. 

Use the transfer function to calculate the frequency response function of 
(D? +2D +1)(D? +6D + 10)(x) = EB” + 2B. 

Use the transfer function to calculate the frequency response function of 
(D? + 2D + 2)(D? + 10D + 29)(x2) = E+ BE". 

Use the poles of the transfer function to determine the long-term behavior 
of solutions of 2” + 2a’+a= E’ + E. 


Use the poles of the transfer function to determine the long-term behavior 
of solutions of 2” + 5a’ + 10a = 2E” + E. 


Use the poles of the transfer function to determine the long-term behavior 
of solutions of 4a” + 4a’ +a = E’. 


Use the poles of the transfer function to determine the long-term behavior 
of solutions of a” + 2a’ + 2a = E’ + 3E. 


Use the poles of the transfer function to determine the long-term behavior 
of solutions of (D? + 2D +1)(D? +6D+10)(x) = EB” +2E. 

Use the poles of the transfer function to determine the long-term behavior 
of solutions of (D? + 2D + 2)(D? + 10D + 29)(x) = BE!" + B”. 

se the definition of the convolution, (7.39), to find t * sin(t). 

se the definition of the convolution, (7.39), to find cost * sin(t). 

se the definition of the convolution, (7.39), to find d(t) * cos(t). 

(7.39), to find Up(t) * e*. 


U 
U 
U 
U 


se the definition of the convolution, (7.39 
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Chapter 7 Projects 


Project 7A: Carrier-Borne Epidemics 

This project is a follow-up on some of the ideas presented in Section 6.4 
and follows the work in Daley and Gani [15]. 

There are certain diseases such as typhoid and tuberculosis in which the 
infectives who are the source of the infection in a population appear 
healthy. Since the infectives appear healthy, they often go undetected 
in the population until the disease spread warrants a mass screening 
program. We call such infectives carriers to distinguish them from sus- 
ceptibles, who, on being infected, may be quickly recognized by their 
symptoms and removed from the population. Once carriers are detected, 
they are removed from contact with the susceptibles. 

The situation described here requires a different type of model than 
presented in Section 6.4. The infection of a susceptible through contact 
with a carrier results in the removal of the infected susceptible, while the 
number of carriers remains unaltered. The carrier population declines 
through a process that is independent of the susceptibles. 

If we let C(t) represent the size of the carrier population at time ¢t and 
S(t) be the size of the susceptible population at time t, then one simple 
model for this carrier-borne infection is 


dS 
HE 7 PSOCH 
= = —7C(t) (7.45) 


with initial conditions S(0) = s9 and C(0) = co, where 8 and y are 
positive constants. 

Solve this system of differential equations to find S(t) and C(t). For 
different values of 6 and y and initial conditions so, co, plot your solutions 
and discuss the behavior of the susceptible and carrier populations. 

In practice, when a carrier-borne disease is recognized in a popula- 
tion where it is not normally present, measures are taken to locate the 
source(s) of the infection. Suppose then that there are co carriers ini- 
tially in the population, and at some time later, say at to, the disease 
is recognized in the population. At this time, efforts are increased to 
remove the carriers from the population so that the carrier removal rate 
¥ is increased to 7. This modification changes the system (7.45) to 

dS 
= = ~S(E)C) 

dC SG) Wen 
de ae t > to 


(7.46) 
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with the same initial conditions $(0) = so and C(0) = co as before. 

Using Laplace transforms, solve this system of differential equations to 
find S(t) and C(t). For the values of 6, y and initial conditions so, co 
you used for the system (7.45), plot your solutions for different values 
of 7’. Discuss the behavior of the susceptible and carrier populations 
comparing your results to the results obtained for the system (7.45). 

One possible modification of the system (7.46) that can be studied us- 
ing Laplace transforms arises by allowing there to be a constant influx of 
new carriers to the carrier population. If we let a be the rate at which 
new carriers arrive in the population (@ can be thought of as an immigra- 
tion rate), and assume that this rate is independent of the populations 
of carriers and susceptibles, then we have the modified system 


dS 
= = -88()CW) 


dC ee Ot t5 


ad \-¥CW)+a t>% ee 


with the same initial conditions $(0) = sg and C(0) = co as before. 

Solve this system using Laplace transforms and perform the same kind 
of analysis you did on the other systems with this system. What is the 
effect of the immigration rate a? 

As a final extension and challenge, we can extend the carrier-borne 
model described by system (7.46) in a different manner. Consider the 
effect of allowing a small proportion k of the susceptibles infected to 
become carriers. This modification changes the differential equation for 
the carriers and gives the equation 


dC 

ae —yC(t) + kBS(t)C(e), 
since the proportion of new carriers introduced to the carrier population 
arises from the infected susceptible population. Using this, the system 
(7.46) with the increased detection rate 7’ becomes 


= -AS(1)0() 
e = —7C(t) + kBS(#)C(). (7.48) 


Observe that this system is similar to the SI model, Equation (6.40) con- 
sidered in Section 6.4. Determine conditions on the stability of the DFE 
and find the basic reproductive number Ro. Interpret the meaning of Ro 
in terms of the parameters of the system. Try to find the unique endemic 
equilibrium of the system that lies in the invariant region. Determine its 
stability and when it is biologically relevant. 
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If the system has initial conditions $'(0) = s9 and C(0) = co, show that 
the number of susceptibles s,, = lim;_,.. S(t) surviving the epidemic is 
the unique solution of the equation 


k (so suo) toy = Fn (=). 


B Sige 


Project 7B: Integral Equations 


The convolution theorem has many useful theoretical applications in 
other branches of mathematics. We will now briefly consider an ap- 
plication closely related to differential equations. 

An equation in which an unknown function occurs in a definite inte- 
gral is called an integral equation. In some applications, the unknown 
function occurs not only in the integral, but in differentiated form in 
other terms of the same equation. In such cases, the equation is called 
an integrodifferential equation. In either case, if the definite integral is 
of the convolution type, then the convolution theorem may enable us to 
transform such an equation into an algebraic equation. 

To illustrate this discussion, we will consider an integral that is of the 
convolution type. Consider an equation of the form 


eG) = | g(t — r)a(r) dr (7.49) 


in which f and g are known functions. Our goal is to find a function x 
for which (7.49) is true. 
If we assume that the functions in (7.49) have transforms, we have 


X(s) = F(s) + G(s)X(s), 
which we can algebraically solve for X(s) as 


F(s) 


BAO) etal 


(7.50) 


Equation (7.50) is the transform of the solution function x(t) of (7.49). 
To find a(t) explicitly, we calculate £~'{X(s)}. 


For example, we can find x(t) so that 


6 Poe =F) Gir 
(=8+ f a(r)sint )d 
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Here, in this equation, f(t) = t? and g(t) = sint so that applying Laplace 
transforms yields the equation 


X(s) =5+ ate 


Solving this equation for X(s) gives 


so that 
Gwe) = Exist =f} {a ae a} 
15 


=?P4 —_— 
5 


Solve the given integral equation using Laplace transforms. 
t 
1. a(t) =t— i (t — u)x(u) du 
0 
t 
Be Ae) = 2 +f x(u) du 
0 
t 
3. c(t) =5— i x(t — u)udu 
0 


As a simple application, consider the current i(t) in a single loop RLC 
circuit which satisfies the equation 


di(t) 
reas Ore fu ip idie—e(b) 


where R,L, and C are constants and e(t) is a known driving function. 


Convert this equation into an algebraic equation in the transform 
I(s) = L{i(t)} by taking the Laplace transform of both sides. If the 
constants R,L, and C are given and the function e(t) has a transform, 
solve for I(s) and find the current i(t) from £~'{I(s)}. 


For instance, in a single loop R-L-C circuit, we have 


a. 
2500 


and a constant driving function e(t) = 30. Using these values, find the 
current i(t) if we assume 7(0) = 0. 
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Chapter 8 


Series Methods 


In this chapter we will explore a different approach to solving an ordi- 
nary differential equation. We have developed many methods in the previous 
chapters for obtaining the solution to an ordinary differential equation; in this 
chapter we will present a method based upon the power series representation 
of a function. 

In previous chapters, we have not discussed (in general) a method of solution 
for an ordinary differential equation with variable coefficients; series methods 
provide one possible method of solution. 


8.1 Power Series Representations of Functions 


We begin with a discussion of the basic properties of a power series. 
A power series in (x — a) is an infinite series of the form 


co 
S- en(x — a)” = co + e1(w — a) + e2(a— a)? +..., (8.1) 
n=0 

where co, C1,---, are constants, called the coefficients (what else would they 


be called?) of the series; a is a constant, called the center of the series; and 
x is an independent variable. In particular, the power series centered at zero 
(a = 0) has the form 


Co 
>, Chu” = co tu t+ cow? +.... (8.2) 


n=0 


It is a very important first observation to note that all polynomials are (finite 
termed) power series. 

A series of the form (8.1) can always be reduced to the form (8.2) by the 
substitution X = «—a. This substitution is merely a translation of the 
coordinate system. It is easy to see that the behavior of (8.2) near zero is 
exactly the same as the behavior of (8.1) near a. For this reason we need only 
study the properties of series of the form (8.2). 
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We say that (8.2) converges at a point x = 2o if the infinite series (of real 
numbers) )>°°_9 Cnxj converges. More specifically, this means that the 


N 
lim y CnXy < 00. 
N-oo 

n=0 


If this limit does not exist as a finite (real) number, then the power series 
diverges at x = xo. It should be clear that the series (8.2) converges at x = 0, 
but are there other values for which the series converges? 

Every power series (8.2) has an interval of convergence consisting of all 
values x for which the series converges. The interval of convergence is given in 
the form |a| < R, where R is called the radius of convergence of the power 
series (8.2). On its interval of convergence, a power series (8.2) converges 
absolutely, that is, the series 


co 
se len] |x| 


n=0 


converges; outside the interval of convergence, |x| > R, the series (8.2) di- 
verges. When R = 0, the interval of convergence consists only of « = 0; when 
R =o, the power series (8.2) converges absolutely for all 2. We can often 
find the radius of convergence from the familiar ratio test we studied in cal- 
culus. We state it here for reference. 


THEOREM 8.1.1 Ratio Test 


Suppose for a numerical series 


Sic (8.3) 


that the limit of the ratio of successive terms is 


Cn+1 
Cn 


lim 


n—->Cco 


= Ik. 


i) If L <1 then the series (8.3) converges. 

ii) If L > 1 then the series (8.3) diverges. 

iii) If L = 1, either convergence or divergence is possible. The test is 
inconclusive. 


| Example 1: Determine the radius and interval of convergence for the series 


[oe} n 


> ESPs 


n=0 
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Solution 


Substituting for each 2 = xo in this power series gives a numerical series with 
coefficients 


so that 


+1 
waar 
: +4+2)2" 
= lim Aree 
n—>0o xo 
(n+1)2” 


_ |ol n+1 
lim 
2 n>0n+2 


_ |20! 

5 
Now the ratio test requires LZ < 1 so 
x 

al, 


which is —2 < ag < 2, so the radius of convergence is 2 and the series converges 
(absolutely) in (—2, 2). 

Convergence of the power series is also possible at the endpoints of this 
interval. If « = 2, the series becomes 


[oe} 


wth aa) 


which is the harmonic series and hence diverges. If « = —2, the series becomes 


n=0 


which converges by the alternating series test. Thus, the series converges ab- 


solutely for —2 < x < 2 and converges on [—2, 2). = 


As we just saw in this last example, a power series may converge or diverge 
at the endpoints of its interval of convergence. In general, extra care must be 
taken when determining whether a power series with interval of convergence 
|x| < R converges at one or both endpoints « = +R. 
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|Example 2:1 Determine the radius of convergence of the power series 
Co 
) nia”. 
n=0 


Solution 

The radius of convergence is found by substituting « = a9 into this power 
series and calculating the limit of successive terms of the corresponding nu- 
merical series. Specifically, 


(n+ 1)laett 
nla 


Cn+1 
Cn 


L= lim 


moo 


= lim 


noo 


= |ao| lim (n + 1) 


= 00 for ro £0. 


The only value that will make LZ < 1 is x) = 0. Thus the power series con- 
verges only for a = 0. 


a 
|Example 3:| Determine the radius of convergence of the power series 
CoO 
ye 
n! 
n=0 


Solution 
The radius of convergence is found by computing 


ntl 


0 
L= lim Se) = lim | ti 
noo Cr noo a 
. n! 
i ea 
= |xo| lim 


Thus, LZ < 1 for all xp, hence the power series converges for all real x. - 
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The interval of convergence for a power series is crucial. For each x in this 
interval, the power series 


foe) 
y Cnt” = co tea + cou? +... 
n=0 


converges. Thus, the series defines, in a very natural way, a function of «x. 
Thus, on the interval of convergence, we have 


f(a) = .o Cnt” 
n=0 


where f(a) is the limit of the series at the value x, that is, 


Now what is truly great about power series is that on their interval of 
convergence they behave nicely. In fact, the function 


f(a) = > Cy x (8.4) 


n=0 


is differentiable on |”| < R. Moreover, the derivative is obtained by term-by- 
term differentiation: 


f(z) = (>. ca) =) nee, (8.5) 


n=0 


and the termwise derivative f’(a) has the same radius of convergence as the 
original series (8.4). This wonderful fact is a consequence of the absolute 
convergence of the series (8.4) on its interval of convergence || < R and 
forms the basis upon which a method of solution of differential equations will 
be developed. 

The series in (8.5) may again be differentiated term by term to obtain the 
second derivative f”(x). In fact, we can repeat this process indefinitely, so 
that the function f(«) defined by (8.4) is infinitely differentiable. 

Observe that 


f(0) = co, 
f'(0) = C1, 
f” (0) = Q!co, 


and that in general 
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Thus, 
(n) 
Cn = f (0) 
n! 
so that (8.4) becomes the Maclaurin series of f(x), 
SFM 
n= > eo a”, (8.6) 
n=0 : 


Any function that has a Maclaurin series (8.6) or, more generally, a Taylor 
series, 


Oo (n)(4 
fa) => FO way, (8.7) 
n=0 . 


which converges to f(x) in the interval || < R for series (8.6) or the interval 
|x — a| < R for the series (8.7), is said to be analytic in the interval |z| << R 
or |e — a| < R, respectively. 

Now, applying these ideas it is possible to obtain power series representa- 
tions of familiar functions. 


| Example 4:| Find the Maclaurin series for 


f(x) =e”. 
Solution 
Since 
f™ (x) = e® for all n > 0, 
then 
f™(0) =1 for all n > 0. 
Thus, 


co co 
0) a” 
} n _ aie 
= +s n! = Ds nl?’ 
n=0 n=0 
which is the series we considered above. We showed that this series converges 
absolutely for |a| < oo. Thus, 


2 3 


F x 

e=1l+r+—4+5+°°:. (8.8) 

2 3! a 

The Maclaurin series (8.8) gives an infinite termed “polynomial-like” rep- 

resentation for e”. Using this series, the function e” can be approximated by 
the first few terms. For instance, using just the first two terms 


ewxrityz. 


Graphing the functions e71 + 2,1+a+27/2 and1l+a2+ = + i, as seen in 
Figure 8.1, higher-order polynomials yield a better approximation. 
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6 1 1 

s}|—e- J 
= Qin 3 4 

4.) 14X+Xx7/2+x°/6 


Loon $x4x"/2 


-2 -1.5 -1 -0.5 0 05 1 1.5 2 
FIGURE 8.1: Three Maclaurin polynomial approximations for e”. 


Now using the same procedure as in Example 4, we can give the following 
power series which are analytic for all a: 


co (=1)9 gent Bi 5 wd 


ae a Qn+m ea ae a2) 
cos 2 = y ae =1 ” - E a (8.10) 
sinh az = 3 ae =24 : + 2 + : ae (8.11) 

cohe= > ay! ao eae (8.12) 


Before we use these series to study differential equations, we consider a few 
useful properties. 


THEOREM 8.1.2 Addition of power series 


If the power series 


Gy) ar Gigs Con? ees 


and 


bo b,x box? SP ace 
converge for a given value of «x, then for that same value of x we have 


(bo + b)0+ bon? +...) + (ep Hare + er? +...) 
= (bp + co) + (b1 + c1)@ + (be + c2)a? +... 
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Power series can be scaled by a constant multiple, as given next. 


THEOREM 8.1.3 Multiplication by a constant 


If the power series 
Coe Gia + Com ee 


converges for a given value of x and a is a real number, then for that 
same value of « we have 


a(co + cra + cou? +---) = aco + aciz + acox* +---. 


Using the distributive property, multiplication of power series is very famil- 
iar. It is just “infinite-termed” polynomial multiplication. 


THEOREM 8.1.4 Multiplication of two power series 


If the power series 
co t+ crt + c2n? +--- 


and 
bo + b1@ + box? +++ 


converge for a given value of |a| < R, then for |a| < R we have 


(bo + 6140+ bow?+. : .)(€o +cqe+ Con? de sac ) 
= boco + (boci ale bic) x ar (doce + bic, + boco) x” aoa 


We have already noted how to differentiate a power series. Integration is 
similar. 


THEOREM 8.1.5 Integration of power series 


If the power series 
co tee + con? +--- 


converges for a given value of |a| < R, then for |a| < R we have 


c c 
[lotart ee? +--)dr=ee+ Ba? + Sah to. 


Let’s look at a few examples. 


| Example 5:| In the exercises, you will show that the power series 


Co 
Soa®=ltetaer +a +. 


n=0 
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converges to 
1 


1-2 


for |x| <1. This is the familiar geometric series. Now if we replace x by —2, 
we obtain the power series 


1 
l-¢+a" aa or (8.13) 


Replacing x by x? in this representation gives yet another power series 


1 
2 4 6 = 
l-a+2 x lean 


(8.14) 


Integrating this power series term by term and noting that 


1 
/ Toe dx = arctan x 


gives the power series for the inverse tangent function as 


oe gt 


t =x-—+—-—+F::-. 8.15 
arctanz = © 3° 5 7 ( ) 


Setting x = 1 in this power series representation gives a remarkable result 


This result, known as Gregory’s series, has been discovered (and rediscov- 
ered) by some of history’s greatest mathematicians. We should note here that 
our argument is not yet completely valid. You should show that the series 


representation for arctan x converges for x = 1. = 


| Example 6: | >) Show, using a power series approach, that 


et t¥ = et ey, 


Solution 
The power series representation for e* is given by (8.8), as 


2 3 
a x 

T— J4 tf... 
e Tra + 3 
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which converges for all real x. Thus, using the product of power series, we 
have 


2 3 yr ys 
"e=(l+a = 14 oe 
ene ( a uae ‘ —s, a 


e 2 P , y3 
14 1lt+y4 
5 a eas wera ea tae )+ 
2 y 
=1l+(r+y) ay ts + 
z+y) 
=1l+(r+y) ( ow) 
ae 


The last equality follows from recognizing the power series expansion for e*T¥. 


| Example 7: | Show, using power series, that 


sin? xz + cos? x = 1. 


Solution 
Using the power series (8.9) for sina we have 


oe a y? gt a gy? at 
sin vt = come ee ee em rn | 


4 
2 x 
= poe aaa eae 
aie 
Similarly, 
2 _ 1 2 - 1 2 = 
ar a 2 a eo 2’ ae 
4 
x 
=l—7?4+24..., 
uae 
Thus 4 
x ae 
sin? x + cos a= (2 ete \e(ine + Ft] 


=1. 
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In addition to these power series manipulations, power series are also useful 
for computing limits. 


bee EEE We know from calculus that 


ve a? at 
sinxvx = 2 3] t 5I 7 t 
it follows that 
: 2 4 6 
sin x x x x 
— 1 31 Br 7 for x £0. 


As we move through our work with power series, we see their nature as infi- 
nite, termed “polynomial-like” functions. Since polynomials are very friendly 
functions, power series must surely be friendly functions as well! 

Before we consider power series methods of solving differential equations, 
we give one additional useful application. 

Many integrals, even simple-looking ones, cannot be calculated in “closed 
form.” Power series, being easy to integrate, offer a useful alternative ap- 
proach. 


Example 9: Approximate 


1 
| sin 2? dx. 
0 
Solution 


Using the power series (8.9) for sinz with x? replacing x, we have 


: x x £ 
sinx? = x? t ee 


which converges for all x. Thus 


x 24 fa at gil gid 
int = fictians 
| A Os a eee TRS! Ib eT! 
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Now, this power series is not a representation for any elementary function. 
But, it is a perfectly good antiderivative of sinx?. Thus, 


1 fa gt gil gid 
| sin t? dt = bee. 
0 2 RSL Tish bk 7 


0 
a 1 _ 
~ 8 7x3!" x5! Ibx7°* 
Ree 1 1 a 
“3 7x3! ilxs5! 15x 7! 
~ 0.3102681578. 
Using a numerical integration routine, we have 
1 
7 sin t? dt © 0.31026830172 
0 
so that the series approximation is very good. - 
e e e e e e e e e e e e 


Problems 


In Problems 1-4, determine the interval and radius of convergence of the 
given series. 


Nx 37a" 
1 2. 
dX 10” » (n+ 1)? 
oS (Tiger! oo 2" (x —_ 3)P 
3 4. 
2 (2n — 1)! d n+3 


Show, using a power series argument, the following identities in Problems 5— 
8. In Problem 8, assume that the power series representations for e”, sing, 
and cosx are valid for complex numbers z = x + iy, where x and y are real 
and 7 is the imaginary number. 


1 
5. sin2a = 2sinxcosx 6. ce” = — (Hint: Show e-“e” = 1.) 
e 
1= : 
7. lim —“* = 8. e’” = cosa+isin x (Euler’s formula) 
xz—0 bs 


9. Among the simplest and most useful power series, known as the geometric 
series, iS 


S(z)=1+a+e?+23+...= 5 00%. 
n=0 


(a) For which real numbers x does S(x) converge? Why? 


(b) What function does the series converge to? Why? 
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10. Derive the power series representations (8.9)—(8.12). Show that each of 
these series is analytic for all x. 


11. Consider the function f(x) = { a . a 
(a) Show that f has derivatives of all orders at « = 0 and that 
foO=f"'O)=..=0. 
fle) ~ FO) 


You might want to use the limit f’(0) = li 
«20 x 


(b) Conclude that f(a) does not have a Taylor series expansion at xz = 0, 
even though it is infinitely differentiable there. Thus, explain why f is 
not analytic at 7 = 0. 


12. Suppose that two functions f(a) and g(a) have Taylor series expansions 
f(z) = ap +a1(@ — cc) + a2(z2—c)? +... 
g(x) = bo + by (a — c) + bo(@ — cc)? +... 
for |x — c| <r. Show that 
(a) The Wronskian of f and g at c is agby — aybo. 
(b) f and g are linearly independent on |a — c| < r if W(f,g)(c) 4 0. 


8.2 The Power Series Method 


The fundamental assumption made in solving a linear differential equation 
of the form 


f(a yysy",.-.) =0 
by the power series method is that the solution of the differential equation can 
be expressed in the form of a power series, say 


Co 


y= So ex” Scot eet egu?+---. (8.16) 


n=0 


Since a power series can be differentiated, term by term, it follows that 
y’,y”,... can be obtained as 


y = > nenw” + = cy + 2con + 3c3u7 +++: (8.17) 
n=1 
y= > n(n lena”? = 2c +3- Qega+---. (8.18) 
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These series can be substituted into the given differential equation and the 
terms involving like powers of x are then collected. Such an expression would 
be of the form 


co 
ko + kat kon? +...= 5 > kna” =0, (8.19) 

n=0 
where ko, ki, ke,--- are expressions involving the unknown coefficients 
Co; C1, C2,-::. Now Equation (8.19) must hold for all values of x in the 
interval of convergence; so all the coefficients ko, ky, k2,... must be zero, that 


is, 


ko =0, ki =0, ko =0, -:- 


Using these equations, we may be able to determine the coefficients co, C1, C2,.-- 
of the power series solution y. We illustrate this method in the next several 
examples. 


| Example 1: Solve the initial-value problem 


y =yte? 
with y(0) = 1. 
Solution 


Using the Equations (8.16) and (8.17) in the differential equation y! = y + x? 
gives 


C1 + 2ege + 3egz7 +... = (cg + ae+ae?+...)+27. 


Collecting like powers of x we obtain 


(cy Co) t (2c. C1)x t (3c3 C2 1)x? + (4c4 = c3)x° +...=0. 


Equating each of these coefficients to zero gives the equations 
cy — Co = 0, 
2cg — cy = 0, 
3¢3 — Co —1=0, 


Aca —-c = 0, 


From these equations we have co = c; and 

CL _ Co 
QQ!’ 

co +1 _ © +2 


rr ae ie 


2 = 
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C3. Cg +2 
4 Al 


C4 = 


We now substitute these back into the power series solution (8.16) y to get 


Co 9 Co +2 3 Co +2 4 
1 ayo 


Y=Cot+cor 4 
The initial condition y(0) = 1 gives 
l=coot+0+0+... 


so the series becomes 


_ 3.4 
rae fee, 


This almost looks like an exponential power series. If you look at it hard 
enough, you will see (maybe) that adding and subtracting 


2 


x x x? 
y=a(1te+5 r 3] = 2(1t2+5). 


Now we see that the series is the power series of e”. Thus, the solution is 


gives 


y = 3e” — x — Qe — 2. 
(i 


This is our first example; we will not always be so lucky to recognize a 
power series expansion. Note that this equation is a first-order nonhomoge- 
neous linear differential equation and we could have solved it as such. 


| Example 2: Solve the differential equation 


y’ +y=0. 


Solution 
Using the Equations (8.16) and (8.18), we have 


(2c9 +3-2cga+...)+(co+ce + coz? 4+...) =0. 
Collecting like powers of x gives 


(2c + cp) + (3: 2c3 +: e1)a + (4-3c4 + c2)a7 +... =0. 
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Each of these coefficients must be zero, so 


2c2 + co = 0, 
3-2c3 +c, = 0, 
4-3c4+c¢9 = 0, 
5-4es + c3 = 0, 
Thus, 
_  & C1 c2 Co C3 Ci 
eS ge a eS a ae Bd 


Using these coefficients in the power series (8.16) for y gives 


Co 9 Ci 3 


C 
x x ae 
2! 3! 


Cy 5 
ay 


Bt 


YH=Coteyxr at 


This can be written as the sum of two power series 
_ 1 o* gt 2° eg af 
oe) (ame a A a ls ae Te a 


Here, again, we recognize each of the power series, the first series is that of 
cos and the second is the one for sinz. Hence, the solution is 


y =cocosx+c sing. 


Note that this differential equation is a second-order homogeneous equation 


with constant coefficients. = 


You might now wonder why we did the power series approach on the last 
two examples, as each was solvable by our earlier methods. The next two 
examples will reveal one of the reasons we have introduced this method. 


| Example 3: | Solve the differential equation 


y! + ay +y=0. 


Solution 
Using power series written in summation notation (for the sake of compact- 
ness) we have 


Co 


x a(n — eae”? +2 x NCp art + 3 cnx” = 0. (8.20) 
n=1 n=0 


n=2 
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Now, to group coefficients of like powers of x, we need to collect the sums 
into one single sum. The procedure is akin to change of variables techniques 
in integration and is as follows. For the first sum 


Co 


S,= > n(n —1)en2"~?, 


n=2 


we will obtain an exponent k by substituting & =n —2. Thus, n =k+2 and 
we see that n = 2 gives k = 0 while n = o gives k = oo. Thus we have 


co 


Si = J (B+2)(b +1 cepor*. 
k=0 


Next, we need to re-index the second series 
co co co co 
n—-1 n a k 
So=2 NCpyx a NCpw” = kepn” = hepa”. 
n=1 n=1 k=1 k=0 


Note here that the last expression follows since kc,x2* = 0 when k = 0. Finally, 
the third series becomes 


So, the expression (8.20) becomes 


(k+2)(k + legron® + keya® + ye cya” = 0. 
k=0 k=0 


“3 


> 
tl 
fon) 


Gathering like powers of x gives the expression 
S> [(K+2)(K+ enzo + (b+ Nex] 2* = 0. 
k=0 


Setting the coefficients in the brackets to zero gives the general recursion 
formula 


ys + 2)(k + L)cps2 oF (k + L)cy = 0. 


This gives cy so that 
is gives Ch42 = = 
Co Cy c2 Co c3 C1 
@Q=-—, 3 =-=, “=-— = — , =->=7>) 
. ae geo cee ee 5 68-5 
The power series for y can be written in the form 
Co 2 C1 3 Co 4 C1 5 
= S| 
y=oot+ eer a ae ar a too5" 
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Separating the terms that involve cp and c; gives 
1 ie y ee a 2 
= ae 
_— 2°24 2-4-6 
x 


3 ee? at 
+c, | x + iscsi 
: ( ae? we, ) 
There is no closed form for either of these series. This does not mean that this 
solution is not useful. Indeed, it is a perfectly good (and natural) solution. For 
instance, suppose that the differential equation satisfied the initial conditions 
y(0) = 1 and y/(0) = 1; then co = 1 and c; = 1. The solution is 


o 2 og 
=l+az fore, 
# , 3° 8 te 
Graphing 1+2,1+2 2 Lhe a “ and1l+a = 4 © asin 


Figure 8.2 gives an idea of the behavior of this series solution. 


—1+x 
—t4x-x?/2 *] 
~~~ 44x4x7/2-x3/3 

ai #4 X°/2-X°13 4°18 
-2 -1.5 -1 -0.5 0 0.5 1 1.5 2 


x 


FIGURE 8.2: Four approximate solutions to the differential equation y”” + 
xy’ + y = 0 with initial conditions y(0) = 1 and y/(0) = 1. 


|_| 
| Example 4: Find a power series solution of the initial-value problem 
dy dy 
2 
1 + 3. = 0, 
) dx? Mag Pe 


with y(0) = 4 and y’(0) = 6. 


Solution 
Since the initial conditions are prescribed at 2 = 0, we will seek a power series 
solution about this point. We assume a solution of the form 


lee) 
y= ) Veter rae 


n=0 
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This gives 
co 
= x nepw”! 
n=1 
and = 
d’y n—2 
5 = > n(n — 1)ena 
dx = 


so that substituting these into the differential equation gives 


(z? —1) 3 n(n — 1)en2"~? + 32 > Nene” +4 . Cnt” = 0. 
n=2 n=1 n=0 
Thus 
yee) see x £8 nea" + Yoo 
n=2 n=2 


so that reindexing the second and fourth series gives 


Yoni (n= 1)cenx2” a + 2)(n + 1)en4o2" +3 3 NCp xe” + > Cn—12" = 0. 
n=2 n=0 n=1 n=1 


Combining like powers of 7 and writing just a single series gives 


—2c2 + (co + 3c1 — 6c3) x4 yl (n+2)(n4+1)en42+n(n+2)en +en—i]x” = 0. 


Comparing coefficients we have 


—2co = 0 
co + 3c, — 6c3 = 0 


and 


=(n+ 2)(a+ Iegso + a(n + 2)e, +¢,-1 =0 forn > 2. 


This gives cz = 0 and c3 = zC0 + $C, and the recurrence relation 


n(n + 2)en + Cn—1 
(n+ 1)(n + 2) 


Cn4+2 = for n > 2. 


Applying this recurrence relation successively yields 


8c + C4 1 " 
CAS Ss > > 
. 12 iP 


lbe3 +e2 _ 1. 3 
a 8 


Oo = 
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so that 


Co Cy 3,4 4, Co, 38c1 Ba. 
y=atort(2+2)2 t T5% ‘(23 a) 084 


This series can be written as 


1 il 1 1 3 
yao (14 peo abt) ba (ot os esate), 


8 
Now applying the initial condition y(0) = 4 gives 
co = 4 


and differentiating the series gives 


1 5 3 1 15 
yfaa(Se+ sett) +e (1 5e + get al | -) 


so that y’(0) = 6 gives 
qi = 6. 


Thus, the power series solution that satisfies the initial-value problem is 


1 1 1 1 3 
yaa(1t as tert) 46(04 a 4 ot Sa p--) 


11 1 11 
= 3 4 5 
+ 6x 3% +n + 7 8 


Suppose now that the initial-value problem of Example 4 was replaced by 
the initial-value problem 


with y(5) = 4 and y’(5) = 6. 


This problem is virtually the same as Example 4; however, the initial-values 
in the problem are prescribed at x = 5, instead of x = 0. We seek a power 
series solution of the form 


Co 


y= eS Cn (a — 5)”. 


n=0 
The simplest way to proceed here is to make the substitution t = « — 5. Here 
x =t+5 and the initial-value problem becomes 
d?y 
dt 


dy 


((¢+5)? -1) a 


+3(t+5) 


+ (t+ 5)y =0 
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with y(0) = 4 and y'(0) = 6. We then seek a solution in powers of t of the 


form 
co 
y= Cale’ 
n=0 


Thus, this problem is now very similar to Example 4 and it is suggested that 
the reader pursue the calculations to obtain the c,,’s. Once the c,’s are found, 
the initial conditions y(0) = 4 and y/(0) = 6 can be applied; then replacing t 
by x — 5, the solution to the original initial-value problem is obtained. 


Taylor and Maclaurin series can also be used to find power series solutions 
to differential equations. This is a slick method. 


| Example 5:| Again, consider the differential equation 


y =yt+2, 
with the condition y(0) = 1. 
Solution 


Differentiating both sides of the differential equation repeatedly and succes- 
sively evaluating each derivative at the initial-value of x = 0, we have 


y'(0) = (y+27)|,_, =y0) =1, 
y"(0) = @ + 22)|,-9 =y' ©) =1, 
y"(0) = (y" + 2)|,29 = y" (0) +2 =3, 
(0) = ¥" leo = ¥'" (0) = 3. 


Substituting these values into the Maclaurin series (8.2) gives 


of yl) 


n! 


n=0 
ea a? 3a Bat 
which we obtained earlier. a 
e e e e e e e e e e e e 


Problems 


In Problems 1-14, solve the following differential equations using the power 
series method. Also solve the equations using one of the methods we have 
presented earlier, if possible. 
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y? — x with y(0) = 
y, + ee with y(0) = ib 
1. 


y 2y = «x? with y(1) = 1. 
y 

y —2? =y? with y(0) = 

y 

¥y 


2. y! — 
4.y'=ax+4+y with y(0) =1. 
6 y 
8.y' = 


+ any with y( 


I 


0) 
e* +siny with y(0) = 0. x? + 2y? with y(0) = 
Saabs + with y(0) =1 10. y =1+2asiny with y(0) = 0. 
1. y! =2? +y yah) 1. 12. 7/ =23 +4? with y(1) =1. 
13. y"+y=14+2+4+2? with y(0) =1 and y/(0) = —1. 
14. y” — xy’ + y? = 0 with y(0) = 1 and y’(0) = —1. 


1. 
3. 
5. 
7. 
9. 
1 


In Problems 15-17, find the general power series solution to the differential 
equation. Try to recognize the solution in terms of familiar functions. This 
may not be possible. 

15. (1+27)y"”+2y'+2ry=0. 

16. cy” — x?y' + (a? — 2)y =0, y(0) = 0 and y’(0) = 1. 

17. y" — 2xy' — 2y =a, y(0) = 1 and y’(0) = —-1/4. 


18. Sir George Biddell Airy (1801-1892) was Lucasian professor of mathe- 
matics, director of the observatory, and Plumian professor of astronomy 
at Cambridge University in England until 1835. He was then appointed 
director of the Greenwich Observatory (Astronomer Royal). He remained 
there until his retirement in 1881. He did much work in lunar and so- 
lar photography, planetary motion, optics, and other areas. The Airy 
equation 

y” _ ry = 0 
has applications in the theory of diffraction. Find the general solution of 
this equation. 


19. The Hermite equation in honor of Charles Hermite (1822-1901) is 
ie / 
y —2xy + 2py = 0, 


where p is a constant. This equation arises in quantum mechanics in 
connection with the Schré6dinger equation for a harmonic oscillator. 
Show that if p is a positive integer, one of the two linearly independent 
solutions of the Hermite equation is a polynomial, called the Hermite 
polynomial H,(z). 


8.3. Ordinary and Singular Points 


The power series method we have considered in the previous section some- 
times fails to yield a solution for one equation while working very well for an 
apparently similar equation. 
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| Example 1: | Consider the differential equation 


ay" + aay’ + by = 0. 
Apply the power series method for each of the following cases: 
Case 1: a = —2, b=2. 


In the differential equation, set 


Co co Co 
y= x nz”, y! = i nenw” ', and y” = x n(n — lena”? 
n=0 n=1 nm=2 
Then, since n(n — 1) = 0 at n = 0 and 1, 
foe) lo e) Co 
xy” + ary! + by = x? x a(n — cae"? + on ye nepw) + bs Cn xv” 
n=0 n=0 n=0 


co 


co co 
= n(n — 1)epa” + S- ancy x” + x ben x” 
n=0 n=0 


= [n(n — 1) +an+ b] e,2” 
n=0 
=0. (8.21) 
Now substituting a = —2, b = 2 into (8.21) gives 


be (n? — 3n + 2)ce,2" = 0. 


n=0 
Equating the coefficients to zero gives 
(n — 2)(n— 1)cy = 0, 
which means that c, = 0 for all n #1 or 2. Hence, 
yYr=axrt+ cou" 


is the general solution when a = —2, b = 2. 
Case 2: a=—landb=1. 


Substitution into (8.21) gives 


LS (n? — 2n + 1)e,2" =0, 


n=0 
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so 
(n—1)?e, = 0. 


Thus, c, = 0 for all n £ 1, so that the solution is 
Y = Ca. 


But here we note that the differential equation 


ry” + ary’ + by =0 


is second-order, so that its general solution involves two linearly independent 
solutions. The power series method has given us only one. We use the method 
of reduction of order to find the other solution. 

Let y = xv so that 


x? (axv)" — «(avy + cv = 0, 


and this equation becomes 


” 


eu" +270! =0. 


Now making the substitution z = v’, we obtain the first-order separable dif- 
ferential equation 
dz 
o— +a7z=0, 
dx 
so 


r . 
Thus, 


c : : 
v' = —, which gives v = cln|a|. 
x 


Thus, the general solution is 
y = Act Beln|z|. 
Note here that In|2| is not defined at x = 0, so it is not a surprise that the 
power series method failed to obtain this term as part of the solution. 


Case 3: a=1landb=1. 


Equation (8.21) becomes 


[o<) 


c> (n? + 1)e, =0. 


n=0 


Equating the coefficients to zero gives 


(n? + 1)en = 0, 
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so 
Cn = 0 for every n, since n?+1 #0. 


Thus, the power series method fails completely in helping us find the general 
solution. The general solution is 


y = Acosln|a|+ BsinIn |a|. 


Check it! 
(Check it!) = 


We will now present conditions under which the power series method does 
work. One also notes here that the methods of Chapter 4, Section 3 apply. 


THEOREM 8.3.1 
There is a unique Maclaurin series y(x) satisfying the initial-value problem 


y Palry — bla)y=0, 


with y(0) = @ and y/(0) = @, provided a(x) and b(a) can each be rep- 
resented by a Maclaurin series converging in an interval |z| < R. The 
power series y(x) also converges in |a| < R. 


This result guarantees that the power series method works whenever a() 
and b(x) are analytic (have convergent Maclaurin series) at 2 = 0. We need 
some terminology. 


Definition 8.3.1 


The point x = Zo is called an ordinary point of the differential equation 
y” +a(x)y’ + W(x)y = 0 (8.22) 


when both a(a) and b(a) are analytic at = a. If x = zo is not an 
ordinary point, it is called a singular point of the differential equation. 


If we write each of the second-order homogeneous equations in the previous 
example in the form (8.22), we have 


a b 
y fy + y= 6. 
x 4 0 


We see here that neither of the terms 


a b 
=-—orb(s&)= 5 

a(x) =“ or W(x) = 5 

are defined at x = 0, so that they fail to have a power series representation 


that converges in an open interval containing x = 0. 
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Consider the differential equation 
(1—27)y" — zy’ + 2y = 0. 
Rewriting this equation gives 


WV x / 2 
1—a2? : toge” 


for which we see that 
a(a) = —— and b(a) = — 
Each of these functions has a Maclaurin series 
a(z) =—a2(1+2?+a27+...) 
and 
b() = 2.1+2?+a4+...) 


so that « = 0 is an ordinary point and the power series method will yield the 
general solution. Note here that « = +1 are singular points of these functions, 
so that a Taylor series centered at 2 = +1 may or may not exist. 

This is a specific case of a special type of differential equation. The CebySev 
differential equation is given as 


(1 —2*)y” — ay +p°?y =0 (8.23) 


where p is a constant. 

Pafnuty Lvovich CebySev (1821-1894) (pronounced and often written as 
Chebyshev or Tchebyshev) was a mathematics professor at the University 
of St. Petersburg. He made numerous important contributions in the areas 
of probability theory, number theory, special functions, and mechanics. The 
Cebysev differential equation (8.23) has some very interesting properties, some 
of which we now consider. 


| Example 2:| Solve the differential equation 


(1—a7)y"” — vy’ + py =0. 


Solution 
Rewriting the equation as 


" zt r, 
, Tae Te 


gives x = +1 as singular points. Thus, on the interval (—1, 1) letting 


y(x) = S- Cnx” 


n=0 
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and substituting into the differential equation gives 


d-2 ) Deu n—1)x te nx” ey ate 


n=0 
Simplifying this expression and rewriting gives 


co 


SSlent2(m + 2)(n + 1) — en(n? — p?)Ja” = 0. 
n=0 


Comparing coefficients gives the recurrence relation 


Cn+2 = forn =0,1,2,---. (8.24) 


(n + 1)(n 4+ 2) 


This recurrence relation yields the even terms as 


2 2,2 
_ Heo _ —(4—4)"p*co 
c= 2 > C4 = 24 ’ 
and the odd terms 
Wee (1= W?)(9 = 22) 
: 6” 120 


so that the general solution is 


—H og , —(4—H? wg 
= 14 oF oe 
y(x) = ( ne A x + 


-_ (: inv 3, G84") 5, ). 


If jz is an even integer, we see that all even coefficients having index greater 
than js are zero. For instance, when jz = 4 we have 


(42 = 4? )eq 0 
aS ——OcRPc_ a 
° 30 
so that cg = 0,cip = 0---. Thus when yp = 4 the recurrence relation gives 
C2 = —8¢o, C4 = —C2 = 8¢o, C6 = Cg = Ci0.--- = 0. 


Using these values, we have the fourth-degree polynomial 
P(x) = eo[1 — 8t? + 8¢*] 


as a solution of CebySev’s equation (8.23). 
Similarly, if w is an odd positive integer then we also obtain a polynomial 
of (8.23). These polynomial solutions of (8.23) for each nonnegative integer 
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valued ps are known as Cebygev (Tchebyshev) polynomials of the first kind and 
T,,(x) is usually used to denote these nth degree CebySev polynomials. The 
first few CebySev polynomials are 


Ij(#)=1, MW(e)=2, Th(z)= 207-1 
T3(x) = 403 — 32, Ty(x) = 804 — 827 +1, 


and a graph of T>(x), T3(x), and T(z) is shown in Figure 8.3. More properties 
and aspects of CebySev polynomials are considered in the Problems. 


L n L L L 
-1 -0.8 -0.6 -0.4 -0.2 0 02 #04 06 0.8 1 


FIGURE 8.3: The CebySev polynomials T>(x), T3(x), and T(z). 


| 
We next consider a method of solution about a singular point. 
Solutions about Singular Points 
Consider the second-order homogenous linear differential equation 
a d 
fo(z)—% + fila) + fala)y =0 (8.25) 
dx dx 


and suppose that xo is a singular point. In this situation we are not assured 
that a power series solution 


co 


y= x Can” 


n=0 


exists. We need to find a different type of solution, but how should we ap- 
proach the problem? 
To this end, we need to make a definition. 
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Definition 8.3.2 
Consider the differential equation 


dy 


fol) 4 + ay 


dx 


+ fo(x)y = 0 
and assume that at least one of the functions 


p(e) = 28, qe) = 2 


~ fol)’ ~ fo(e) 


is not analytic at x9 so that xg is a singular point of the differential 
equation (8.25). If the functions defined by the products 


(a —29)p(x) and (x — 29)?¢q(z) (8.26) 


are both analytic at xo, then 2p is called a regular singular point of the 
differential equation (8.25). If either or both of the functions defined by 
(8.26) are not analytic at xo, then po is called an irregular singular point 
of (8.25). 


| Example 3: | The differential equation 


3a 
7 dx? dx 


+ (a +2)y=0 (8.27) 


can be written as 
d?y 4 dy , @+2) 


dz? 3adx  3a2 ” 0, 
so that , . 
- u+ 
p(x) = ap and q(x) = “agar 


Both fail to be analytic at « = 0. Thus, 2 = 0 is a singular point of the 
differential equation (8.27). Now the products are 


xr+2 
3 2 


—4 
xp(x“) = a and 2?q(x) = 


both of which are analytic at « = 0. Thus x = 0 is a regular singular point of 
the differential equation (8.27). 


i>] 
eve EN The differential equation 
d? d 
2?(2 — 2)? SY 4 2(¢ 2) + (w@ + 1y =0 


dx? 
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can be written as 


d?y 2 dy (x +1) 
dn? * x? (x — 2) dx F x7(x — 224 aad eee) 
so that a4 
x 
p(x) ~~ x2 (a _ 2) and q(x) aan x(x = 2)2 


are not analytic at ¢ = 0 and « = 2. Thus x = 0 and w = 2 are singular 
points of the differential equation (8.28). 
Now at x = 0, we consider the products 


2 x+1 


e)) and ak cramer 


p(x) = 
here x7q(zx) is analytic at 2 = 0, while xp(x) is not analytic at x = 0. Thus 
x = 0 is an irregular singular point of (8.28). 

Next considering the point « = 2, the products 


r+1 
2 


(2 — 2)p(x) = 5 and (# — 2)?q(x) = — 


are both analytic at « = 2 so that x = 2 is a regular singular point of (8.28). 


These ideas lead us to develop a method of obtaining a series solution when 
the differential equation has a regular singular point. We will develop this 
method in the next section. 


Problems 


For each of the following differential equations in Problems 1-6, find all sin- 
gular points. Determine if these points are regular or irregular. 


1. (x? — 3x)y"+(a@+2)y+y=0. 2. (a? +27)y” + (x? — 2ax)y’ + 4y = 0. 
3. 27(x + 2)y" + xy’ — (22 -1)y=0 4 (2°+24—-6r3)y"+27y'+(x—2)y = 0. 
5. (2a + 1)a?y” — (x + 2)y’ + 2e7y = 0. 

6. (xt — 223 + x)y" + 2(2 — 1)y’ + 2?y =0. 


7. The CebySev differential equation (1 —?)y" — xy! + u?y = 0 has the poly- 
nomial solution T,,(a) when n is a nonnegative integer. Using the recurrence 
relation (8.24) find T5(a) and T(x). 

8. (a) Show, by substitution, that 


y(a) = cos(n arccos(z)) 
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is a solution of the Cebysev differential equation 
(1—2*)y" — ay’ +n?y =0 


with n a nonnegative integer and -l1<a<l. 
(b) Show for n = 0, 1,2 that the function 


y(x) = cos(n arccos(x)) 
is a polynomial in x and that T,,(«) = y(a). Show that 


This cos(narccos(x)) for |a| <1 
n\“)™* ) cosh(narecos(x)) for |2| > 1. 


8.4 The Method of Frobenius 


We now proceed to give a result concerning solutions about regular singular 
points. 


THEOREM 8.4.1 
If vp is a regular singular point of the differential equation 
d?y 
dx? 


fol) 4 + fale) + faloy = 0, 


then this differential equation has at least one nontrivial solution of the 
form 


co 
|z — xo|” Cn(@&— Zo)”, 
n=0 


where r is a constant (that can be determined) and this solution is valid 
in some (deleted) interval 0 < |” — x9| < R, R > 0, about zo. 


|Example 1:1 We have seen that 7 = 0 is a regular singular point of the dif- 


ferential equation 


d 
dx? dx 
the theorem assures us that there is (at least) one nontrivial solution of the 


form 
co 
ja|" YS Cr” 
n=0 


which is valid in the interval 0 < |a| < R about x = 0. 
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| Example 2:| We know the differential equation 
dy 
2 2 
2 
oe=2) dx? dx 


has a regular singular point at « = 2 so that there is (at least) one solution 
of the form 


+ 2(@ — 2)— + (x + l)y =0 


co 
lz — 27 Scale — 2)", 
n=0 
which is defined for all values in 0 < |x — 2| < R. 
Now, in the case x = 0, an irregular singular point of the differential equa- 
tion, we cannot say that 
co 
|x|" a Cn x” 
n=0 


is a solution in any interval 0 < |a| < R. = 


Question: How do we determine the coefficients c, and the number r when 
Zp is aregular singular point of the differential equation? 


The method we consider is very similar to the preceding method of solution 
for ordinary points. The method we will now develop is often called the 
method of Frobenius. 

Georg Frobenius was born in Charlottenburg, Germany in 1849. He re- 
ceived his doctorate at the University of Berlin (awarded with distinction) in 
1870 under the supervision of Weierstrass. In 1874, after having taught at 
the secondary school level for several years, he was appointed to the Univer- 
sity of Berlin as an extraordinary professor of mathematics. Frobenius made 
enormous contributions to group theory, particularly group representations, 
linear algebra, and analysis. In [20] Haubrich gives the following overview of 
Frobenius’s work: 

The most striking aspect of his mathematical practice is his ex- 
traordinary skill at calculations. In fact, Frobenius tried to solve 
mathematical problems to a large extent by means of a calcula- 
tive, algebraic approach. Even his analytical work was guided by 
algebraic and linear algebraic methods. For Frobenius, conceptual 
argumentation played a somewhat secondary role. Although he ar- 
gued in a comparatively abstract setting, abstraction was not an 
end in itself. Its advantages to him seemed to le primarily in the 
fact that it can lead to much greater clearness and precision. 

Frobenius developed a method of determining the coefficients c, and the 
number r when 2o is a regular singular point. We will illustrate this method 
on the first differential equation we considered. 
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| Example 3: | Find a solution to the differential equation 


4a— + (a+ 2)y =0 (8.29) 


in some interval 0 < x < R. 


Solution 
Since « = 0 is a regular singular point, we know that 


oo 
y= |x|" PS Crt” 
n=0 


is a solution on 0 < |a| < R. 
Thus for 0 < x < R, we seek a solution of the form 


Co 
y=u" Cyt 
n=0 
lee) 
n=0 
Now o 
t= = 
= en(n+r)a"tr 
dx — 
and 
dy = 
hes pS en(ntr)(ntr—1)a"t"-? 
x 
n=0 


so that substitution into the differential equation (8.29) gives 


Py, dy 
oa” Ta 4n— + (a+ 2)y 

= 3R" 2 Cn(ntr)\(ntr—lartr-? 

n=0 
—4Ax , Calm ret?! +(e +2) - je" 

n=0 n=0 

= 3 > en(n+r)(n+r—1)2"t" 

n=0 


Co lo e) Co 
—4 y en(n+rja"tr + ) Char trtt +92 ) Cyan 
n=0 n=0 n=0 


= 0. 
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Simplification of this expression gives 


S 5 (3(n tr)(nt+r—1)—4(n+r)4 Q)enat +S” Cp_aa™t? =0 
n—O0 n=1 


or equivalently 


(3(r(r-1)—4r +2) cz" +5 [(3(n tr)(n-+r—1)—4(n+r)+2)ent+Cn—1]2"*” = 0. 


n=1 


Assuming cp 4 0 and equating the coefficient of the lowest power of x to zero 
gives 
(8r(r — 1) — 4r + 2)c9 = 0 


or 
3r(r — 1) -—4r+2=0. 


This quadratic equation, known as the indicial equation, is 
3r? —7r+2=0 
and has roots 
Ty =- and m=2. 


These roots are known as the exponents of the differential equation and are 
the only possible values for the constant r. Now equating the coefficients of 
higher powers of x to zero we obtain the recurrence relation 


B(n+r)(n+r—1)-—A(n+r)+2)e,+¢n-1=0 for n>1. 


$ we obtain 


1 2 1 
(s(n 3) (n 3) A(n+5) +2) en tera=0 for n>1 


which simplifies to 


Now when 7; = 


n(3n—5)e,+e-1=0 for n>1 


or 


—Cn-1 
Cn = > for n> 1. 
” n(3n — 5) i 
Thus 
Co 
cq = 9? 
=C1 —€9 
Q= = = 
2 2 4 ’ 
=C9 Co 
C3 = CU Ol 
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so that 


1 1 Lig. og 
Yi = Cots (1450 Tha aa” sc) 
is the solution corresponding to r, = 3. 
Similarly, rg = 2 gives the recurrence relation 
(8(n + 2)(n+ 1) —4(n4+ 2) +4+2)e, +en-1 =0 for n>1 
which simplifies as 


n(3n+5)en +en-1 =0 for n>1. 


This gives 
—Cn-1 
1 = — fo >1 
" n(3n + 5) os 
so that 
—Co = =Gii = Co = =169 _ —Co 
Se gh =e. ie ae ago” 
This gives 
1 1 ik 
2 2 3 
= Cos 1 x ee 
ee ( 8 176  7302° ) 
as the solution corresponding to the root rg = 2. 
These solutions, corresponding to ry = 3 and rg = 2, respectively, are 


linearly independent, so the general solution of the differential equation (8.29) 


is 
1 Hl il 
y= het (14 x x 4 x? a) 


2 4 48 
1 1 1 
2 2 3 
t+kox (1 3? 176" 7399" +...) 
where k, and kz are arbitrary constants. = 
We now outline the method we presented in this example. 
Outline of the Method of Frobenius 
For xp a regular singular point of the differential equation 
d? d 
fol) 5-5 + file) = + fa(a)y = 0, (8.30) 


to find a solution valid in some interval 0 < |a — xo| < R, 
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1. Assume a solution of the form 


CO 


y = (%— 2)" > Cn (% — 2%)” 
n=0 
co 
= » Cn(a — x9)" 
n=0 
where co # 0. 
2. Differentiate y term by term to obtain 
dy = n+r—-1 
a oz Cn(n +1r)(x — 29) 
mu n=0 
and 
dy = 
Fee = Dotaln + r)(n+7r—1)(e— a9)? 
x 
n=0 


and substitute these expressions into the differential equation (8.30) for 
dy 
dx?” 


3. Simplify the expression so that it is of the form 


of and 


Ko(a = cy el + Ky(a _ zo)" t*tt + Ko(a = i ia +...=0 


where & is an integer and the coefficients K;,i = 0,1,2,... are functions of r 
and some of the coefficients cy. 
4. To be valid for all x in 0 < |x — x0] < R, 


Ko=K, =Ko=...=0. 


5. Upon equating to zero the coefficient Ko of the lowest power r + k of 
(x — xo), we obtain a quadratic equation in r, called the indicial equation 
of the differential equation (8.30). The two roots are called the exponents of 
the differential equation, denoted by r; and rg. Here ry and rz can be distinct 
real numbers, repeated real or complex. For convenience, 7; is such that 


Re(r1) > Re(r2). 


6. Equate the remaining coefficients K,, K2,... to obtain a set of equations, 
involving 7, which must be satisfied by the coefficients c,, in the series. 

7. Substitute the root r; for r obtained in Step 6 and then determine the c,, 
which satisfy these conditions. 

8. If ro Ary, repeat Step 7 using rz instead of ry. 

9. The general solution is obtained as a linear combination of the solution(s) 
obtained in Steps 7 and 8. 
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| Example 4: “= Use the method of Frobenius to find a solution of 


1 
MN / 
+ (1+: y= 
ay" + (1+ a)y — Fey 
Solution 
Rewrite this equation as 
l+z2 1 
iW / 
=0 
= © 16227 
so that iz i 
Ht i _— 
p(z) and q(x) = 
Both fail to be analytic at « = 0, so x = 0 is a singular point. Now 
-1 
ep(t)=1+2 and 27q(x)= ie 


are both analytic at « = 0, thus « = 0 is a regular singular point. 
Thus, there is at least one solution of the form 


[oe} 


ys S- Cn (a = toy" with co a 0. 


n=0 


Differentiating gives 


and 


yf = > en(n+r)(n+r—1)(% — 29)"*"~? 


n=0 


which yields upon substitution into the differential equation 


x x en(ntr)(ntr—1)2"t"-? 


n=0 
co 1 [oe} 
1 ahr =<) eae = 0. 
+( me) Dig (n+r)a Tez 2°" 
Rearrangement gives 
1 [oe} 
rr a aay ai | con” * + d n(n +r)(n+r— lat 
+ a ea(n +t ret tr—t + S- en(n +r)a"tr 
n=1 n=0 


= 
= —— n+r—-1 _ 0 
d rent ; 
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and further simplification gives 


rr-D+r— 3 wa + ([intrintr-ntm4n-z Cn 


n=1 


+(n+r— 1)en-1) grtr—l — 9, 


Equating the first coefficient to zero with co £ 0 gives the indicial equation 


1 
r(r—1)+r i6 
which is j 
2 
= =. 
" 6 
This quadratic equation has roots rj = + and rz = —i. Thus, the differential 


equation has two solutions 


Co co 

1 = 

Y= y Cnx"t4 and y= y Chaz” 4. 
n=0 n=0 


Now, using these series, we can find the coefficients. 


Beginning with the larger root r; = + and equating the series coefficients 


to zero gives 


(+3) 6-3) +9) -Be (ddan 


so that the coefficients c, must satisfy the recurrence relation 


(3 — 4n)en-1 


— f 2 1; 
2(2n? + n) ue bee 
Hence 
_ ae cee = 1 
aq = 6°” C2 = ring — 94 C3 = 112° 
Using these gives 
— 1 1 1 + 1 2 1 34 
Y1 = Cox id a4” 112” P86 sa oo Ice 
Similarly, we use the root rg = —+ so that 


(=) Delt) (-Jan-o 


This yields the recurrence relation 


(5 — 4n)en—1 


> 
Don? —n) for n>1 


Ch = 
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that the coefficients c, must satisfy. The values are 


1 i 7 
mart (14 x x? 4 x” ae 


Forming a linear combination of y; and yg gives a general solution of the 
differential equation as 


y = Cry + Coy2 
1 1 1 
=Opns (1 r+ —x? xv 4 3) 


1 1 1 7 
ea al : oe 
+Cox~ 4 ( + 57 — 3 + 5407 ) 


The previous calculations, while straightforward, can be quite tedious and 
there is a lot of room for algebraic error. You might imagine that it would 
be easier to use MATLAB, Maple, or Mathematica to find the coefficient of 
the assumed form of the series even with the extra complication of a regular 
singular point. It will be a bit more complicated as we will have to first deal 
with the indicial equation. 

In the previous examples, we have found the indicial equation via direct 
substitution of the series solution into the differential equation. The method 
of Frobenius depends upon the roots of the indicial equation so it is of interest 
to obtain a general formula for this equation. 

Proceeding here, we will assume for simplicity that « = 0 is a regular 
singular point of the differential equation 


— + p(x) = + q(x)y = 0. (8.31) 


Otherwise, if s = rg # 0 were a regular singular point, we could then write 
X =2-—42%p. Then the functions 


ap(x) and 27¢q(a) 


are analytic at « = 0. Thus, both xp(x) and x?q(x) have convergent power 
series representations. 
That is, 
p(x) = po + pit + poe +--- 


and 
x?q(x) = qo + qe t qx? +--- 
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or alternately 
Po 
p(x) = rs + pi + pow + psa? +++: 


and 


qd 1 
dz)= 24+ 2+ ataset---. 
x x 


Now substitution of these series into the differential equation (8.31) gives 


& cet in tr amr) + (2 + py + pox + p32? 4 < 


x 
n=0 
co 
x (>. Cn(n + ner) 
n=0 
+ (444404 a0+...) 
x T 
lo e) 
x (> eat = 0. 
n=0 


Expanding a little gives 


(> at + r)(n +r— pan) 
n=0 
‘a (>: Cnpo(n + name) 


n=0 


co 
+ (p, + pot + p3x? +...) & en (n+ nen) 
n=0 
lo) 
+ (>. canter) 
n=0 
qd co 
+ (2 + 2+ q3r+.. ) (Seem) an 
== 


Thus, with n = 0, the coefficient of x"~? is given as 


—reo +7r?co + reopo + coGo = Co(r? + (po — 1)r + Q0) 
= ¢o(r(r — 1) + por + qo). 


So for a differential equation of the form 
d?y dy 
dz? + p(t) z + q(x)y = 0 


with « = 0 a regular singular point, the indicial equation is given as 


r(r—1)+ por +40 =0 (8.32) 
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or 
r? + (po — 1)r +40 = 0. 


The values of r that satisfy this equation are called the exponents of the 
differential equation and are found from (8.32) using the quadratic formula. 
These exponents are 


1—po + V/1— 20 +p —4 1 — po — /1— 2p + Be — 4a 
my = Lo Pot V1 = 2p0 + P5— 440 og p, — La Po V1 2p0 + Po ~ 49 


2 2 


_ 4. _ a: 2 
Po = lim ap(x) and go = lim #°q(z). 


Determine the indicial roots for the following differential equa- 


tions. 1 
(a) y” — 35) * 3,v 9 (b) ay” +y'—y=0. 


Solution 
(a) Here we note that x = 0 is a singular point of the differential equation 
which is regular since 


1 1 
p(x“) = 3 and = 2q(x) = 3" 
Now po = —% and go = $ so that the indicial equation is 
1 1 
r(r—1)+por+ qo =r(r-1)- arts =0. 


That is, 
4 1 
2 
—-=r+-=0, 
eee a 
which has roots r; = 1 and rg = z. 


(b) Rewriting this differential equation as 


we see that x = 0 is a singular point since 


pz) == and g(x) = — 


fail to be analytic at « = 0. 
Now xp(x) = 1 and x?q(x) = —2 are both analytic at x = 0, sor =Oisa 
regular singular point. Here 


=a ls _ _ 1 2 -_ 
po = lim ap(z)=1 and qo = lim x*q(x) = 0 
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so the indicial equation is 
r(r—1)+por+q =r(r—1)+r=0, 


that is, 
2 
re =0. 


So the roots here are ry) = ro = 0. 


Determine the indicial roots for the following differential equa- 
tions given in (a)—(b). 


1 
(a) xy” + (sinx)y’ — (cosx)y = 0 (b) a?y” + 5(@ +sinz)y’+y=0. 


Solution 
(a) Rewriting this differential equation as 


sinz , COsx 


A 
+ 
y 7 ¥ ——2 


y=0 
xv 


gives that x = 0 is a singular point of the differential equation as 


sin x — cos 2 

pe) = "22 and g(a) = = 

fail to be analytic at x = 0. 
Now 
ee x 
TE ee NE BET 
oe et 
=l- 3I + ar = 

So xp(z) is analytic at x = 0. Further 2?q(x) = — cos x which is (clearly) also 


analytic at « = 0. Thus x = 0 is a regular singular point. Now 
po = lim xp(z)=1 and qo = lim #*q(x) = -1, 
which gives the indicial equation as 
r(r—1)+por+q=r(r—-1)+r—-1=0 


sO 
r?—-1=0. 


The indicial roots for this differential equation are 


ry=1 and rg=-l. 
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(b) This differential equation can be written as 


dy 1 /x+sine dy 1 0 
dx? 2 x de x27 


so that x = 0 is a singular point as 


x+singe 1 
x) = —~ —___ and z)=—> 
p(x) = 248 (2) = <5 
are not analytic at x = 0. 
To see that 2 = 0 is a regular singular point expand xp(a) as 


(c+sinz) a«+sing 1 sing 
Qu? Oe 2 Qu 


xp(x) = «x 


so 
po = lim xp(x) = 1. 
«x0 


Further, 2?q(x) = 1 which is analytic for all x. Now the indicial equation is 


r(r—1)+port+qo=r(r—-1)+r+1=0 
which is r? + 1 = 0 and has (complex!) roots 


ry=t and rg=-i. 


These examples give some of the possible situations that can arise when 
finding the indicial roots of the differential equation. The first example we 
considered has distinct real roots and applying the method of Frobenius is 
similar to the previous examples we have considered. 

In the next example we consider a differential equation with distinct real 
roots that differ by an integer value. This particular case requires a bit of 
additional care. 


| Example 7:| Find a general solution of 


dy dy 
2 2 
x qg2 + 3) 7, + 3y = 0. 
Solution 
In this differential equation 
73 3 
p(z) = zs . ~ and q(z) = > 
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which fail to be analytic at « = 0. However, 


and 
a7 q(x) = 3, 


which are both analytic at « = 0. Hence, x = 0 is a regular singular point. 
Now 


po = lim xp(z) = -3 ands qo = lim 27 q(x) = 3 
x20 x0 
so the indicial equation is 
r(r—1) + por+qo =r(r—1)-3r+3=0, 


that is, 
r?—4r+3=0. 


The indicial roots are rj = 3 and rg = 1. These roots differ by a positive 
integer. We assume solutions of the form 


CoO CoO 
yi = 2° y Cnt” and yw=2 y C0" 
n=0 


n=0 
Now - 
Yi = Do(n + 3)ena”?? 
n=0 
and 2 
yf = SO(n + 3)(n + 2)ena”* 
n=0 
so 
x? Sn +3)(n+ Qe,e"** + (2? — 3) So(n + 3)e,2"*? 
n=0 n=0 


foe) 
+ 3 Ss Cnc t? = 0. 
n=0 


Simplifying and equating the higher powers of x to zero give 
[(n + 3)(m + 2) — 3(n + 8) + 3Jen + (N+ 2)en-1=0 for n>1, 


which is 
n(n + 2)en +(n+2)en-1=0 for n>1. 
Thus, the recurrence relation that the coefficients c,, must satisfy is 


Cn—-1 


Cn = — for n>1 
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sO 


= — 4 Co C2 Co 
cy =—Co, C2>= 9 Or C3 3 ~3r 
Indeed, in general, 
—1)r 
4, ae 
n! 
so 
3 qe fa (-1)"a2” 
Y= Cov Se op ag ey ee 


= cone. 


For the root rz = 1, we obtain the recurrence formula in the same manner as 
above. Thus, for y2 the coefficients must satisfy 


n(n — 2)en +Nepn-1 =0 for n> 1. 
Now for n 4 2, we have 


Cn—-1 
n— 


Ch = — for n>1,n#2. 
So, forn = 1 
C1 = Co 


and for n = 2, 
2-Oc2 + 2c1 = 0, 


which is c,; = 0. However, this implies co = 0, a contradiction of our as- 
sumption. This contradiction implies that there is no solution yg of the form 
oo) n—1 
ta= >, ap one 
This can be emphasized further by considering the coefficients c, for n > 3; 
from the condition 0 - cz + 2c; = 0, co must be arbitrary, so for n > 3 


—C3 C2 —C4 c2 


c3 = —C2, a= > oP 3 =F 


so that using these values of the coefficients gives 


gt @ (-1)"2"*2 
x we 
= cr? f a4 ai 3i Pace a ( 1) nl | 
=cor°e* 


which is the solution obtained for y,. 
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This really should not be a surprise as the indicial roots r, and rg in this 
example differ by 2. [This value of 2 appears as the factor of x? in the 
expansion of y2 in equation (8.33).] 

So, in the case of the indicial roots differing by an integer, only one solution 
will arise from the method of Frobenius. To find another (nearly independent) 
solution of this differential equation, we employ the method of reduction. 

Here, let y = f(a)v where f(x) is a known solution of the differential 
equation. In this case for y; we have, with co = 1, 


From this, we obtain 


dy 3 _,dv — ey 
moe a + (3a7e we *)v 
and 
dy 3 d-v du 
= —x 9) 2:3. =f 3-2 
q-°° a + 2(3ae xe ere 


d?v dv 
Letting 
_ du 
~ dx 
reduces the order and we obtain 
d 
c— +(3—2)w=0. 
dx 


This first-order linear differential equation has solution (check it!) 


Thus 


v= fwar= f a-*erde. 


Y=YW= ses fate dx, 


Hence 


which is a linearly independent solution from y1. 
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Now it is interesting to note the series form of y2; expanding e” in a power 
series gives 


2 3 4 
maate? fo (14045 ae to) de 


2! 3! 4! 
1 il 
mate [ (oF 4074 “4 + 5qzt ) ae 
—1 1 1 1 1 
_— 30-2 l an eee 
EF a wee ae 


where we integrated the series, term by term. 
Now writing e~” in series form gives 


of 88 4,2 Ps 1 eee a 
= ee 2 26 48 


Tg 
= al 
a nz 


1 4 Li sy hg 1 
= ; | Pea ia = nz. 
x x a qe 5r e x 
Note the logarithm here is of the form cy; Ina. 
The general solution of the differential equation is thus 


y = Cryi(x) + Coye(x) 


where C and Cy, are arbitrary constants. = 


In this last example, it was fortunate that we were able to express the 
solution y in closed form. This simplified the computations involved in finding 
the second solution y2. The method of reduction still may be applied even if 
we cannot find a closed form for the first solution y;. We would carry out the 
computations term by term in the series for y;. These computations can be 
quite spectacular and are often very complicated. 

We will now consider (briefly) the case of complex roots of the indicial 
equation. 

Suppose that the indicial equation 


r(r—1)+ por +q0 =0 
had complex roots r; and rg. Here r; and rg occur as complex conjugates so 


that ifr; = a+bi then rg = a—bi where a,b are real, b 4 0. Now ry —1r2 = 2bi, 
so the difference of these roots is not an integer. Therefore, the solution will 
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not contain a logarithmic term as we had previously. Thus, we assume a 


solution of the form 
co 
yy = ax" s. Cnc”. 
n=0 


But how do we treat a complex exponent x2"! = «@+"? 
Recalling Euler’s formula 


e” =cosx+isinaz 


gives 
gat bi = gig = = gteblnz)i 


= x"[cos(bInx) +7sin(blna)] for « > 0. 
Thus, the series for y; will have coefficients c, that are complex. Writing 
Cn =Ayn+ib, for n> 0 


formally gives the series 


Co 


yi(a) = a" Vic + iby )a” 


n=0 


x"|[cos(blna) + ¢sin(bInz)] pS Anxw” +14 = bx” | 
= x" “ Ina) oo a,x" — sin(bIna) > - 


n=0 n=0 


cos(bIn x) » bna” + sin(bIn z) y on : 


n=0 n=0 


+ix® 


We note here that both the real and imaginary parts of y;(a) are real func- 
tions. From this analysis, we see that differential equations with complex 
indicial roots have solutions that are complex valued. The solution y2(a) cor- 
responding to the complex conjugate root rz is the conjugate of y;(a). It can 
be shown that y;(#) and y2(x) are linearly independent. We will close this 
discussion by considering an example of this case. 


| Example 8: | ==) Consider the differential equation 


gy" + ay! +(1—2)y =0. 


Rewriting this equation as 
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gives that x = 0 is a singular point of the differential equation as 


1 1-2 
p(z)=— and g(x) =—, 
x x 


both which fail to be analytic at « = 0. However, xp(a) and xq(a) are analytic 
at x = 0, so « = 0 is a regular singular point. 
Now 
po = lim ap(x) =1 and gq = lim xq(x) = 1, 
«+0 x20 


so the indicial equation is 


r(r—1)+por+qo=r(r—-1)t+rt+1 
=r741=0. 


The indicial roots or exponents for this differential equation are 
ry =i and ro =-1. 


Thus, if we assume a solution of the form 


we have 
Co loc) 
y=ax y Cnt” and y=axu' y Cre”. 
n=0 n=0 


Formally treating this imaginary exponent of xz as one would treat a real 
exponent, we have upon differentiation of y; that 


Co 
yi = So(n +ije,0°*-* 
n=0 
and 
Co 
yi = So(n +i) (n+i— ea", 
n=0 


so substituting into the differential equation gives 


[oe} co [oe} 
x So (n+é)(n+i-lcaa™* +2 So (n+i)ena”t* 1+ (1-2) ye et ah, 
n=0 n=0 


n=0 


Equating coefficients to zero here gives the recurrence relation for the c,’s as 


1 
Cn+1 = @pitie fi” 
(n+ 1) — 2% 
= nm iL > 0. 
Grits” ee 
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Clearly, this recurrence relation will generate complex-valued coefficients in 
terms of co. To simplify our calculations we will take co = 1 +7, solely as an 
illustration. Thus, 


cq = co = 


[4 We 3-1 1— 22 
ce. = C= => 5 
8 8 2 20 


s=9: 3-2i\ (1-21) -(1+ 81) 
Cc = 2 SS ; 
39 39 20 780 


so that taking the real and imaginary parts we have 


-1 
1 = —., a= —— 
ao > Ay 5? ag 20’ a3 780’ 
and 
-1 -1 —2 
bo = 1, bh = bo = 
0 » OL 5? 2 = 497 °3 = Jos? 
Using these we obtain the solution 
3 1 1 1 
yi (x) = cos(In x) f zt eral | sin(In 2) f — gr 0” +] 


1 1 1 
+ icos(In zx) [1 - ra 0” +: | + sin(In x) i+ on + P+] . 


The solution y2(x) is found from the conjugate of y; (x). 


Problems 


For each of the following differential equations in Problems 1-12, apply the 
method of Frobenius to obtain the solution. 

sy” —y=0 2. (x2 +.2)y” — 2y’ — 2y =0 

Qa? bee a oe ee 4. xy! ay’ + (22° +5) y= 0 

6 

8. 


wow 


1. 
3. 
5. oy" + ale + Iy’—y=0 eee —ay'+y=0 

7. 2x*y"” + vy’ + (x? —1l)y=0 x? + 2x3)y" + (x? —2x)y’ +y =0 
9. 

1 


ny ty ty =0 10. xy ee mas ae 
1. (2? +. 23)y"” — (22 +2)y' +y=0 12. 2?y" + (2? — x)y’ + 2y = 0. 
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8.5 Bessel Functions 


We will now develop the theory of a type of function that occurs in connec- 
tion with many problems in applied mathematics, physics, and engineering. 
Its diverse applications range from electric fields to heat conduction to appli- 
cation in abstract probability theory. 

The differential equation 


dy dy 


a re p’)y = 0, (8.34) 


where p is a parameter, is called Bessel’s equation of order p. Any so- 
lution of Bessel’s equation of order p is called a Bessel function of order 
p. The differential equation (8.34) and its solutions are named in honor of 
Friedrich Wilhelm Bessel (1784-1846) who first studied some of their remark- 
able properties. [It should be noted here that the solutions of (8.34) are called 
Bessel functions, not the possessive Bessel’s functions. This is common prac- 
tice with Bessel functions but is not typical of mathematics in general. For 
example, Green’s functions (possessive form) are solutions to another type of 
differential equation.] 


Bessel Functions of Order Zero 
If p = 0, Equation (8.34) becomes 
d’y dy 


v2 + i. +axy=0, (8.35) 


which is called Bessel’s equation of order zero. We will first find solutions 
of this equation in an interval 0 < a < R. 

Noting that « = 0 is a regular singular point of (8.35), we assume a solution 
of the form 


i ean (8.36) 
n=0 


with co 4 0. Differentiating (8.36) twice and substituting into (8.35) gives 


Co co Co 
So(n +r)(n+r— lee) + s(n +regettrt + = Cnr ttt! = 0. 
n=0 n=0 n=0 


Simplifying this expression, we obtain 


CoO 


foe) 
So(n 4. cree 4 > a ie = 0, 


n=0 n=2 
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recon”) + (L+r)e.a" + Sol(n +1r)?¢n + Cn—glz"t" + = 0. (8.37) 


n=2 


Thus, upon equating to zero the coefficient of the lowest power of « in (8.37) 
gives the indicial equation 
2 
r- = 0, 
which has (clearly) two equal roots r; = rg = 0. This gives, by equating to 
zero the coefficients of the higher powers of «x in (8.37), 


(1+1r)7e, = 0, (8.38) 
and 
(n+r)c, +h =0 forn>2. (8.39) 
Taking r = 0 in (8.38) gives c; = 0 and, again letting r = 0 in (8.39), we 
have the recurrence 
nC, +Cn_-2 =0 forn> 2, 
or more usefully 


Cn—2 
Cn = -——5 for n > 2. 


Using this expression, we obtain successively 


—Co —Ci 0 —C2 Co eso oe 0 
ge ge Oe ae yg ey ga 
so that we see all the odd-termed coefficients are zero and the general form 
for the even-termed coefficients is 
(—1)"co (—1)"c 


= _ 0 
Con = Seg2G2..- (Inj? (njegen? FORMS) 


Thus, when r = 0 in (8.36) the solution of Bessel’s equation (8.34) is 
a pay 
y(z) = 0D (nly? e 


Setting the arbitrary constant co = 1, we obtain the particular solution of 
Bessel’s equation (8.34), 


= 
8 
~— 
II 
Me 
oq 
SIZ 
wl 3 
aN 
wles 
a 
iw) 
3 


n=0 


This particular situation defines a function, denoted by Jo, and is called the 
Bessel function of the first kind of order zero. Thus, 


as > a Cl (8.40) 
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FIGURE 8.4: The Bessel function Jo(«). 


is a particular solution of (8.35). A graph of Jo(x) is shown in Figure 8.4; 
note that Jo(#) has a damped oscillatory behavior. 

Since the indicial equation had two roots that were equal, we know that a 
solution of (8.35) that is linearly independent of Jo is of the form 


lo) 
y= oy ca” + Jo(a) Ina 
n=0 


for 0 < x < R and constants c*. Using the method of reduction of order, we 
see that this linearly independent solution yz is given by 


1 
en dx 


y2(x) = wa) | oye a= 4) | ear 


Now 
2 4 6 2 4 6 
2 = 1 x xz x ; 1 His x xv ; 
Jo(n)] | 1164 23047 4° 64 2304 - 
4 x? 304 528 % 
i 2° 32 576 
so 
1 4 wy Sat, 232° 
[Jo(z)2 °° «2 «82 «CO#B76 
This gives 
dx 
= J 
(2) = le) | 
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and simplifying further gives 


x? bat 232% 
y2(x) = Jo(x) fina + a+ 128 7 | 


x 5a* 232° 

Jo(x) na + Jo(x) | Z + 128 + 3456 + | 

nn x n a 5a* 2326 
64 2304 


x? 3x4 1126 
= lnz free, 
Jo(x) Ina + 7 — tog + T3R04 


= Jo(x)Ina + F 


so we have found a form of the second solution, but in this form of the ex- 
pansion we will have trouble finding the general coefficient c3,,. 
Noting that 


5 4 141 
aarp (2) ~ 92 4? 


1 1 3 3 
1)? 1 = = 
(-1) 94(2!)2 ( 5) 2492.2 128’ 
(14 1 ee ee) ae are 
26(3!)2 o° 3 2662-6  13824° 


It seems that, in general, 


This is indeed the case, as can be shown (cf. Watson [51]). Using this fact, 


we have 
oo Lyerly 2n _% 


yo(x) = Jo(x) Ina 4 = = Ie i . (8.41) 


n=1 


Now Jo(a) and y2(x) are linearly independent so that the general solution 
of (8.35) can be written as a linear combination of Jo(a) and y2(x). However, 
it is more customary in the theory of Bessel functions to write a “special” 
linear combination of Jo(a) and y2(x). This combination is defined as 


= tuo(2) — (y— n2)(2)] 


where ¥ is the number 


‘ 1 1 1 
y= Tit: (lap bee ie 


~ 0.5772, 
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which is known as Euler’s constant. 
This second solution of (8.35) is the function 


oo 1)"t1y an 7m i 
Yo(x) = acto )Inz 4 a z + (y—In2)Jo( | 
n=1 k=1 


or 


£2 1)"+1y on Te 4 
(8.42) 


¥o(0) = = (m5 4) ste Jo(x ie 2 Lak 


The function Yo(x) is called the Bessel function of the second kind of 
order zero. The expression (8.42) is known as Weber’s form of Yo(x). So, 
taking Yo(a) as the second solution of (8.35), the general solution of (8.35) is 
the linear combination 


y =C\Jo(x) + CoYo(x) for0<a< R, 


where C; and C2 are arbitrary constants, with Jo(a) defined by (8.40) and 
Yo(x) defined by (8.42). 

A graph of Yo(a) is shown in Figure 8.5, and both Jo(a) and Yo(a) are 
shown on the same graph in Figure 8.6. Note that the zeros of Jo(x) separate 
the zeros of Yo(). 


=1 


FIGURE 8.5: The Bessel function Yo(x). 


Bessel Functions of Order p 
We will now consider solutions of Bessel’s equation 


x +o + (2? — p*\y=0 (8.43) 
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FIGURE 8.6: The Bessel functions Jo(a) and Yo(x). 


for real p > 0 and valid for 0 < « < R. Studying Equation (8.43), we see that 
x =0 is a regular singular point, so we can assume a solution 


p=) Ge (8.44) 
n=0 


valid for 0 < « < R with co 4 0. Proceeding as we have done previously by 
differentiating (8.44) and substituting into (8.43) and simplifying, we obtain 


(r° — pcos" a7 [(r + 1)? —p |ca"t! + dill + r)? — pen + Cn—2)x"™" = 0. 


n=2 
(8.45) 
Equating the coefficients of (8.45) to zero gives 
r?—p? =0, since co # 0 (8.46) 
[(r +1)? — p*]er = 0 (8.47) 
and 
[(n+r)? — pen +¢n-2=0 for n> 2. (8.48) 


Equation (8.46) is, of course, the indicial equation for the differential equation 
(8.43). The indicial equation has roots r; = p > 0 and rg = —p. Now if r; — 
rg = 2p > 0 is not a positive integer, then we know from the previous section 
that the differential equation (8.43) has two linearly independent solutions of 
the form (8.44). On the other hand, if r1 — rg = 2p is a positive integer, we 
are only certain of a solution in the form (8.44) to exist corresponding to the 
larger root r; = p. This is the solution we shall now proceed to obtain. 
Thus, letting r =r; = p in (8.47) gives 


(2p + Le = 0, 


but since p > 0, we have c; = 0. Letting r = r; = p in (8.48) gives the 


recurrence relation 
Cn—2 


ee > ds : 
oe (8.49) 


Cn = 


8.5. Bessel Functions 639 


Now since c, = 0, (8.49) gives that all odd coefficients are zero; further we 
find that the even coefficients are given by 


(-1)"co 
[2-4...(2n)][(2 + 2p)(4 + 2p)... (2n + 2p)] 
7 (1) 6 
~ 2nnl((1+p)(2+p)...(n+p)] 


C2n = 


forn > 1. 


So, the solution of the differential equation (8.43) corresponding to the larger 
root p is given by 
(— 1)"x 2n+p 


ae y  Prnl[( + p24)... (n +P) co 


If p is a positive integer then (8.50) can be written as 


yi (x) = co2’p! 3 ee ‘ae (8.51) 


+ p)! 


What if p is not a positive integer? In this case, to express yi(x) in a form 
similar to (8.51) we need to introduce a function that generalizes the notion 
of the factorial. 

For a > 0 the gamma function is defined as 


T(a) = [ ge" de (8.52) 


which is a convergent improper integral for each value of a > 0. Integrating 
(8.52) by parts one time gives the recurrence relation for a > 0 


T(a) = (a—1)T(a— 1), (8.53) 
so that if @ were a positive integer, repeatedly applying (8.53) yields 
a! =T(a+1). (8.54) 


It is in this sense that if a > 0 but not an integer, we use (8.54) to define a! 

Some of these properties may seem surprising. The gamma function, as do 
the Bessel functions, all belong to a broad class of functions that mathemati- 
cians, physicists, and engineers term special functions. Special functions 
are functions, usually defined in terms of a convergent power series or integral, 
that play a special role in the solution of some problems of practical impor- 
tance. The gamma and Bessel functions we are studying in this section are 
perhaps new to you and their properties may seem surprising and unfamil- 
iar. However, the class of special functions contains very familiar functions as 
well. One only needs to remember that the functions e”, sina, and cos are 
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all defined as convergent power series [although this is not how you probably 
first learned of them], to realize that the “strangeness” of the properties of 
the gamma and Bessel functions is just an artifact of their newness to your 
collection of mathematical facts. 

Special functions have been extensively studied. Indeed there are some 
excellent texts that develop the theory and relations of these and other special 
functions. 

Returning now to our discussion of the gamma function, we see that so far, 
we have defined I'(a) for a > 0. It can be shown that 


so that using (8.35) we can compute, for instance, T(3), that is, 


()-#@) 


In this way, we could say (3)! = Sve 1.3293. For other positive values of 
a, (a) may need to be calculated numerically using (8.52) and a numerical 
integration routine. 

For values of a < 0, the integral (8.52) diverges so that I'(a) is not defined 
for a < 0. However, we can extend the definition of ['(a) to a < 0 by de- 
manding that the recurrence relation (8.53) is valid for all values of a. In this 
way, (a) becomes defined for every noninteger negative value of a; a graph 
of T'(a) is shown in Figure 8.7. 

We digressed to the gamma function for a purpose. We are interested in 
the solution y:(x) of the differential equation (8.43) when p is not a positive 
integer. In this case, if we use the recurrence relation (8.53) repeatedly, we 
obtain 

Tin+p4+1)=(n4+p)(n+p—1)...(p+ IP (p+ 1). 


So, for p not a positive integer, the solution given by (8.50) becomes 


es) (— 1)" 2n+p 


yi(@) = eo (p+ 1) d 


4, 2PrnlD(n +p+1) 
- ) 


x 2n+p 
= 2 (p4 pS sttret 5 (5) (8.55) 


Note that (8.55) reduces to (8.51) when p = 0. 
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Oo 2 4 6 


FIGURE 8.7: The gamma function I'(z). 


If we let co in (8.55) be given as 


1 


© * ST (p +1) 


we then obtain the particular solution of (8.34) known as the Bessel function 
of the first kind of order p. This function, often denoted J,, is given as 


nT (n+p +1) 


Taking p = 0 in (8.56), we see that (8.56) reduces to the Bessel function of the 
first kind of order zero given by (8.40). Now if p = 1, then Bessel’s equation 
(8.34) becomes 


2 = 
v2 ee + (a —1) =0, (8.57) 


which is Bessel’s equation of order 1. Letting p = 1 in (8.56) gives the Bessel 
function of the first kind of order one, denoted J; and given as 


i= se — (Z)"". (8.58) 


! 
= (n+ 1)! 


A graph of J,(x) is shown in Figure 8.8. Note the damped oscillatory behay- 
ior. Graphing both Jo(x) and Ji(), as shown in Figure 8.9, shows that the 
positive roots of Jo and J; separate each other. 

This is in fact true for the function J,, p > 0. It can be shown (c.f. Watson 
[51]) that J, has a damped oscillatory behavior as x —> oo and that the 
positive roots of J, and Jp41 separate each other. 

We have obtained a solution to Bessel’s equation (8.34) for every p > 0. 
We now find another linearly independent solution of (8.34). We have already 
given such a solution in the case p= 0. This is Yo(a) defined by (8.42). For 
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0.44 


FIGURE 8.9: The Bessel functions Jo(x) and Ji (x). 


p > 0, we have noted that if 2p is not a positive integer, then the differ- 
ential equation (8.34) has a linearly independent solution of the form (8.44) 
corresponding to the smaller root rg = —p. 

Taking r = rp = —p in (8.47) gives 


(—2p + 1)c, = 0 (8.59) 
and in (8.48) we have 
oe gy eo (8.60) 
Cn n(n aes 2p)’ —_— ; ‘Dp. re 


Studying the recurrence relation (8.60), we see that there are three distinct 
cases for the form of the solution y = y2(a). These cases are: 


1. If 2p is not a positive integer then 


yo(x) = cox P (: +0 oa) (8.61) 


n=1 
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where cp is an arbitrary constant and the a2,(n = 1,2,...) are (definite) con- 
stants. 


2. If 2p is an odd positive integer then 


Y2 (x) = co(a)? (: + x ena) + Copa? (: + ye a (8.62) 
n=1 


n=1 


where co and cz, are arbitrary constants and Jon, 7an(n = 1,2,...) are (defi- 
nite) constants. 


3. If 2p is an even positive integer then 


Y2(x) = Copa? (: + 3 bas) (8.63) 


n=1 


where cg, is an arbitrary constant and the 62,(mn = 1,2,...) are (definite) 
constants. 


The solution defined in Case 1 is linearly independent of J,. In Case 2 the 
solution defined is linearly independent of J, if co, = 0. However, in Case 3, 
the solution is a constant multiple of J, and hence is not linearly independent 
of Jp. So, if 2p is not a positive even integer, there exists a linearly independent 
solution of the form (8.44) corresponding to the smaller root —p. That is, if 
p is not a positive integer, Bessel’s equation (8.34) has a solution of the form 


yo(x) = > toe? (8.64) 
n=0 


which is linearly independent of Jy. 

To determine the coefficients co, in (8.64), we note that (8.60) is obtained 
if p is replaced by —p in the recurrence relation (8.49). This implies that a 
solution of the form (8.64) can be obtained from (8.56) by replacing p by —p. 
This gives the solution denoted by J_y as 


oo — 1)" @\ 2n—p 
Joe) =>) ort + 1 (3) 0?) 


n=0 


Thus, if p > 0 is not an integer, the general solution of Bessel’s equation of 
order p is given as the linear combination 


y = cyJp(x) + c2J_p(a) 


where c; and c2 are arbitrary constants. 
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If p is a positive integer, the solution defined in Case 3 is not linearly 
independent of J, as we have already pointed out. So, in this case a solution 
that is linearly independent of J, is given by 


j= ee x” +CJ,(x) Ine 
n=0 


where C #4 0. This linearly independent solution can be found using the 
method of reduction of order, much the same way as we did previously for Yo. 
In this manner, we obtain Y,, so that just as in the case of Bessel’s equation 
of order zero, it is customary to choose a special linear combination as the 
second solution of (8.34). This special combination, denoted Y,, is defined as 


a : (mg +7) Jp(x) 9 (p—n—1) em 
n=0 


n! 


oo nt? 4 2n+p 
7 co (> +d, 2) (am a) "| 


(8.66) 


where ¥ is Euler’s constant. The solution Y;, is called the Bessel function 
of the second kind of order p. This formulation of Y, is sometimes called 
Weber’s form of the Bessel function. A graph of Y;(2) is shown in Figure 8.10. 


=—1.0+ 
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FIGURE 8.10: The Bessel function Yj (x). 


Problems 


1. Show directly that the series for Jo(x), given in (8.40), converges abso- 
lutely for all x. 
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2. Show directly that the series for J; (a), 


oe (-1)" my 2n+1 
a ee 
(2) dX n(n + 1)! \2 
converges absolutely for all x and that 
Ji(x) = —Ji (x). 


3. Using the series for J,(x), 


Jp(x) = do uses 1 Gy”, 


n=0 


show directly that 
dp p 
ae Jp(kx)| = ka? Jp_1 (ka) 
and F 
Gg lt de(ke)] = Sha? 541 (hz) 


where k is a constant. 
4. Show that Jo(kx), where k is a constant, satisfies the differential equation 


d’y dy 
—{4%4kry =0. 
TT2 + em + k*ry =0 


5. Show that the transformation 


u(x 
eo 
Ja 
reduces the Bessel equation of order p 
dy | dy 
2 | | 2 2 = 
a2 teat (e p )y=0 


to the form 


Using this, show that 


cos x sin x 


yi(z) = Ve and y2(x) = Va 


are solutions of the Bessel equation of order one half. 
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6. By a suitable change of variables a differential equation sometimes can 
be transformed into a Bessel equation. Show that a solution of 


1 
ay" + (a7 67478 + 7 —p’B")y=0 forx>0 

is given by y = x f(ax®) where f(-) is a solution of the Bessel equation 

of order p. 


7. (a) Show that the differential equation 


d?y —2t 
qt? ¥=% 


which models an aging spring, can be converted to an equation with 


solution Jo(t) by using the change of variable x = e~‘. 


(b) Predict the behavior of the solution by considering the limiting dif- 
ferential equation as t > oo. 


Chapter 8 Review 


In Problems 1-5, determine whether the statement is true or false. If it is 
true, give reasons for your answer. If it is false, give a counterexample or 
other explanation of why it is false. 


1. When L = 1, the ratio test gives useful information about the convergence 
of a series. 


Power series “behave” a lot like polynomials. 
Only closed-form solutions are useful as solutions of differential equations. 


Every ordinary point is a singular point. 


oe es 


Every function has a convergent power series representation. 


In Problems 6-8, show, using a power series argument, the following identities. 


fi 
6.e%e 7 =1 ea eee 0 8.1—e-* x2 for small x 
xr—0 LC 
In Problems 9-18, solve the following differential equations using the power 
series method. 


9. y' = 2y+6, y(0) =3 10. y =x2+2y, y(0) =3 
11.7’ =y+cosa, y(0) =1 12. y' =3+2y", y(0) =5 
13. y' =e** + zsiny, y(0) =0 14. y! = 27 + 5y, y(0) =6 
15. y! = 22? + y*, y(0) =2 16.y =2°+y7, y(0) =4 


17. y! — 2y = 223, y(1)=1 
18. y” + 24y=4+4 224+ 27, y(0) = 6,y'(0) = —2 
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In Problems 19-21, apply the method of Frobenius to obtain the solution to 
each of the following differential equations. 


19. 27y" — ay + (a? + §)y=0. 20. a?” + ay’ + (2? — 3) y =0. 
21. 32y” — (a — 2)y’ — 2y = 0. 
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Chapter 8 Computer Lab: MATLAB 


MATLAB Example 1: Enter the code below, using Symbolic Math Toolbox, 


i fl 
to find the series expansion of e”, sinx?, and the sum of ae 
iG 


> clear all 

>> syms x k 

>> f1=exp(x) 

>> T=taylor(f1,’Order’ ,8,’ExpansionPoint’ ,0) 
>> pretty (T) 

SS PSsinGeD) 

>> taylor(f2,’Order’ ,8,’ExpansionPoint’ ,0) 
rah ay 

>> symsum(gi,k,1,5) partial sum only 

>> symsum(gi,k,1,inf) 

>> g2=1/xk 

>> symsum(g2,k,0,5) 

>> symsum(g2,k,0,inf) 


MATLAB Example 2: Enter the code below, using Symbolic Math Toolbox, 
to solve the ODE y” + xy’ + y = 0 by series expansion. 


S> elleene cull 

= sys ex CONCING2NCSNC4conco 

>> y=cOtc1*xt+c2Q¥x\2+c3#x"3+c4*x4+c5*x"5 

>> eqODE=diff(y,x,2)+x*diff(y,x)ty 

>> eqi=collect (eqO0DE) 

>> eq2=coeffs(eqi,x) %n must be large enough in y 

>> [c2,c3,c4,c5]=solve(eq2(1) ,eq2(2) ,eq2(3) ,eq2(4) ,c2,c3,c4,c5) 
>> ysoln=subs(y) 
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>> collect(collect(ysoln,c0) ,c1) 


MATLAB Example 3: Enter the code below, using Symbolic Math Toolboz, 


1 
to find a series solution for the ODE xy” + (x + 1)y’ — eas 0, which has 
x 


a regular singular point. 


S=> Glleeie alll 
>> syms) x CO cl c2 c3 c4 cb x 
>> y=cO*xrt+c1#x’ (141) +c2*x’ (Qtr) +c3*x’ (3+r) +c4*x’ (4+r) 
>> yn=cO¥#xr+c1*x’ (1t+r)+c2*x’ (Qtr) +c3*x’ (3+r) 
>> eqODE=x*diff(y,x,2)+(x+1)*diff (y,x)-y/(16*x) 
>> eqi=collect (eqO0DE) 

%#1t won’t collect with x in denom or r in exponent. 

wWe rewrite the expression to get coeffs we need 
>> eqia=collect(simplify(eq1),x) Z%lowest power of x is x(1-r) 
>> eq2=coeffs(eqia,x) %first term is x/(1-r) power 
>> xrcoeff=eq2(2) {coeff of xr 
>> xrpicoeff=eq2(3) %coeff of x (r+1) 
>> xrp2coeff=eq2(4) coeff of x (r+2) 
>> eq3=solve(eq2(1) ,r) 
>> ri=eq3(1) 
>> r2=eq3(2) 
>> cvalsi=solve(xrcoeff ,xrpicoeff ,xrp2coeff ,c1,c2,c3) 
>> cvals=subs([cvalsi.ci,cvals1.c2,cvalsi.c3],r,r1) 
> y=subs(yn, [r,c1,c2,c3], [r1,cvals(1) ,cvals(2) ,cvals(3)]) 
>> cvals2=subs([cvalsi.ci,cvals1.c2,cvals1.c3],r,r2) 
>> y2=subs(yn, [r,c1,c2,c3], [r2,cvals2(1) ,cvals2(2) ,cvals2(3)]) 


MATLAB Exercises 

Turn in both the commands that you enter for the exercises below as well as 
the output/figures. These should all be in one document. Please highlight or 
clearly indicate all requested answers. Some of the questions will require you 
to modify the above MATLAB code to answer them. 


1. Enter the commands given in MATLAB Example 1 and submit both your 
input and output. 

2. Enter the commands given in MATLAB Example 2 and submit both your 
input and output. 

3. Enter the commands given in MATLAB Example 3 and submit both your 
input and output. 

4. Find the Taylor series expansion of e?” about x = 0 up to and including 
x® terms. 


12, 


is}, 


14. 
15. 
16. 
iff, 
18. 
I), 
20. 


Pile 


DOr 


Dn 


24. 


25. 


Chapter 8 Computer Labs 649 


. Find the Taylor series expansion of e?” about x = 1 up to and including 


(x — 1) terms. 


. Find the Taylor series expansion of In(a +1) about x = 0 up to and 


including «” terms. 


. Find the Taylor series expansion of Inz about « = 1 up to and including 


(x — 1)" terms. 


. Find the Taylor series expansion of cos(x?) about x = 0 up to and in- 


cluding x® terms. 


. Find the Taylor series expansion of cos(5a) about « = 1 up to and in- 


cluding (a — 1)° terms. 


. Find the Taylor series expansion of 24 + 22 +1 about « = 0 up to and 


including x* terms. 


. Find the Taylor series expansion of «* + 27 + 1 about x = 1 up to and 


including (a — 1)* terms. 


1 
Find the Taylor series expansion of — about « = —1 up to and including 
ae 


(x + 1)® terms. 


Find the Taylor series expansion of = about « = 1 up to and including 
(2 — 1)® terms. - 

Solve y' — x? = y” by series expansion. 

Solve y’ — e” +siny by series expansion. 

Solve y” + zy’ + y = 0 by series expansion. 

Solve y! = a+ = y(0) = 1 by series expansion. 

Solve y’ = x? + y?, y(1) = 1 by series expansion. 

Solve y” +y=1+2+27, y(0) =1, y’(0) = —1 by series expansion. 
Find a series solution for the ODE xy” — y = 0, which has a regular 
singular point. 

Find a series solution for the ODE 2x7y" + 3xy' — (x + 1)y = 0, which 
has a regular singular point. 

Find a series solution for the ODE xy” + x(x + 1)y’ — y = 0, which has 
a regular singular point. 

Find a series solution for the ODE 2x7y"” + xy! + (a? — 1)y = 0, which 
has a regular singular point. 

Find a series solution for the ODE zy” + y’ + y = 0, which has a regular 
singular point. 

Find a series solution for the ODE (2? + 2°)y” — (2? + 2)y’ +y = 0, which 
has a regular singular point. 
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Chapter 8 Computer Lab: Maple 


Maple Example 1: Enter the code below to find the series expansion of e”, 


i i 
sin z?, and the sum of Rak 
restart 
ew 


taylor(f1, x = 0,8) 
mtaylor(f1, x = 0,8) 


fo = smn(a ) 

mtaylor(f2, x = 0,8) 
il 

i Rp 


sum(g1, k = 1..5) 


k=1 
Co 
gl 
k=1 ; 
Q= — 
g ze 


Maple Example 2: Enter the code below to solve the ODE y+ ay’ +y = 0 
by series expansion. 


restart 
eqODE := y??(x) + 2-y?(x) + y(xz) =0 


n 


euil = af) = SS cp a 
k=0 


eqla := eval(subs(n = 5, eq1)) 
eq2 := eval(subs(eq1a, eqODE)) 
eq3 := collect(eq2, x) 

eq3a := coeff( ths(eq3), x, 0) 
eq3b := coeff(lhs(eq3), x, 1) 
eq3c := coeff(lhs(eq3), x, 2) 
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eqd := coeff(lhs(eq3), x, 3) 

eq4 := solve({ eq8a, eq3b, eg3c, eq3d}, {c2, €3, Ca, C5}) 
egsoln := subs(eq4, eval(subs(n = 5, eq1))) 

eqsoln1 := collect(collect( eqsoln, co), c1) 


Maple Example 3: Enter the code below to find a series solution for the 


ODE zy” + (x+1)y’ 


il 
Te! © 0, which has a regular singular point. 
a 


restart 
OVENS ae NG) SILI eA) 


n 
Cal) = We) = yy cp att 
k=0 


eq1 := eval(subs(n = 5, eqy)) 
eq2 := subs(eq1, eqODE) 

eg3 := combine( expand(eq2), x) 
eq4a := coeff(Ihs(eq3), x”—*) 
eq4b := solve(eq4a, 1) 

eqda := coeff(lhs(eq3), x") 

eqdb := coeff(Ihs(eq3), x'*") 
eqoc := coeff(Ihs(eq3), x2") 
egsoln1 := solve(subs(r = eq4b[1], { eq5a, eq5b, eq5c}), {c1, ca, c3}) 
egsoln2 := solve(subs(r = eq4b[2], { eda, eg5b, eq5c}), {c1, ca, c3}) 
soln := eval(subs(n = 4, eqy)) 

solnl := yi (x) = subs(egsoln1,r = eq4b[1], soln) 

soln2 := yo(x) = subs(eqsoln2, r = eq4b[2], soln) 


3 


Maple Exercises 

Turn in both the commands that you enter for the exercises below as well as 
the output/figures. These should all be in one document. Please highlight or 
clearly indicate all requested answers. Some of the questions will require you 
to modify the above Maple code to answer them. 


1. Enter the commands given in Maple Example 1 and submit both your 
input and output. 


2. Enter the commands given in Maple Example 2 and submit both your 
input and output. 


3. Enter the commands given in Maple Example 3 and submit both your 
input and output. 


4. Find the Taylor series expansion of e?” about 2 = 0 up to and including 
a2® terms. 
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1, 


13. 


14. 
15. 
16. 
lire 
18. 
19. 
20. 


all 


DDE 


23. 


24. 


25. 
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. Find the Taylor series expansion of e?” about x = 1 up to and including 


(2 — 1)® terms. 


. Find the Taylor series expansion of In(a + 1) about « = 0 up to and 


including a” terms. 


. Find the Taylor series expansion of Ina about « = 1 up to and including 


(z — 1)" terms. 


. Find the Taylor series expansion of cos(x?) about x = 0 up to and in- 


cluding x® terms. 


. Find the Taylor series expansion of cos(5a) about « = 1 up to and in- 


cluding (a — 1)° terms. 


. Find the Taylor series expansion of 24 + 2% + 1 about x = 0 up to and 


including «* terms. 


. Find the Taylor series expansion of 24 + 2% + 1 about x = 1 up to and 


including (x — 1)* terms. 


1 
Find the Taylor series expansion of — about « = —1 up to and including 
i 


(2 + 1)® terms. 


Find the Taylor series expansion of a about « = 1 up to and including 
(2 — 1)® terms. a 

Solve y’ — x? = y? by series expansion. 

Solve y’ — e* + siny by series expansion. 

Solve y” + zy’ + y = 0 by series expansion. 

Solve y! = a+ = y(0) = 1 by series expansion. 

Solve y! = x? + y?, y(1) = 1 by series expansion. 

Solve y’ +y=1+2+4+ 27, y(0) =1, y’(0) =—1 by series expansion. 
Find a series solution for the ODE wy” — y = 0, which has a regular 
singular point. 

Find a series solution for the ODE 22x?y” + 3xy' — (2 + 1)y = 0, which 
has a regular singular point. 

Find a series solution for the ODE 2?y” + x(x + 1)y’ — y = 0, which has 
a regular singular point. 

Find a series solution for the ODE 2x2y” + xy! + (x? — 1)y = 0, which 
has a regular singular point. 

Find a series solution for the ODE zy” + y’ + y = 0, which has a regular 
singular point. 

Find a series solution for the ODE (x? + 2°)y" —(a?4+2)y' +y = 0, which 
has a regular singular point. 
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Chapter 8 Computer Lab: Mathematica 


Mathematica Example 1: Enter the code below to find the series expan- 


sion of e”, sina’, and the sum of —, om 
AM ne 

Quit|] 

seal [Exe _]| = GF 

eqi = Series[f1[x], {x, 0, 8}] 

Normal [eq1] 


£2 [x0] = Sinix?] 
Series[f2[x], {x, 0, 8}]//Normal 


gl [k_] = 3) 


Mathematica Example 2: Enter the code below to solve the ODE 
y’ + ay’ +y =0 by series expansion. 


Quit] 

vyilx_] = <cO #clx + cle” fc3x° 4+ cau 4 ch x° 

devia = yiedl) sey? eed yee 

eq2 = Simplify[ReplaceAll[dey[x], {y[x]J-y1lx], y’ [x]>y1’ [x], 
y’?? [x] >y1?? [x] }]] 


eq3a = Coefficient[eq2, x, 0] 
eq3b = Coefficient[eq2, x, 1] 
eq3c = Coefficient[eq2, x, 2] 
eq3d = Coefficient[eq2, x, 3] 


eq4 = Solve[{eq3a==0, eq3b==0 ,eq3c==0,eq3d==0}, {c2, c3, c4,c5}] 
eqsoln = ReplaceAllly1[x], eq4] 
eqsolni = Collect[Collect[eqsoln[[1]], cO], c1] 
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Mathematica Example 3: Enter the code below to find a series solu- 


1 
tion for the ODE xy” +(x+1)y’— = 0, which has a regular singular point. 
Quit[] 


Wels] 2 COse - Cilsere 4 Clee a EBogs db Ease 
Seine _]] = x57? [ell se Gil sp 32) 57? [Bell = 


eqi = Expand[ReplaceAll [eqODE[x] , ila clea y’? [x] yr’ [x], 
Cy aca Ea fey yaree [el] 

ee Coefficient[eqi, x’ +] (*compare to above output*) 

eq2b = Solve[eq2a==0, r] 

eq3a = Coefficient [Coefficient[eqi, x™], x, 0] 

eq3b = Coefficient [Coefficient[eqi, x™'1], x, 0] 

eq3c = Coefficient [Coefficient[eqi, x™'?], x, 0] 

eq3d = Coefficient [Coefficient[eqi, x™'?], x, 0] 

eqsolni = Solve[ReplaceAll[{eq3a==0, eq3b==0, eq3c==0, 

eq3d==0},eq2b[[1]]], {c1, c2, c3, cA}] 

eqsoln2 = Solve[ReplaceAll[{eq3a==0, eq3b==0, eq3c==0, 

eq3d==0},eq2b[[2]]], {c1, c2, c3, cA}] 

yil(x_] = Collect [ReplaceAl1l[ReplaceAll[yr[x], eqsolni], 

eq2b[[1]]], c0] 

y2[x_] = Collect [ReplaceAl11[ReplaceAll[yr[x], eqsoln2], 

eq2b[[2]]], c0] 


Mathematica Exercises 

Turn in both the commands that you enter for the exercises below as well as 
the output/figures. These should all be in one document. Please highlight or 
clearly indicate all requested answers. Some of the questions will require you 
to modify the above Mathematica code to answer them. 


1. Enter the commands given in Mathematica Example 1 and submit both 
your input and output. 

2. Enter the commands given in Mathematica Example 2 and submit both 
your input and output. 

3. Enter the commands given in Mathematica Example 3 and submit both 
your input and output. 

4. Find the Taylor series expansion of e?” about x = 0 up to and including 
x® terms. 

5. Find the Taylor series expansion of e?” about x = 1 up to and including 
(2 — 1)® terms. 

6. Find the Taylor series expansion of In(a + 1) about « = 0 up to and 
including a” terms. 


i, 


i133, 


14. 
15. 
16. 
if, 


18. 
ig), 
20. 


2k. 


DD 


Ds 


24. 


25. 
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. Find the Taylor series expansion of Inz about xz = 1 up to and including 


(2 — 1)" terms. 


. Find the Taylor series expansion of cos(x?) about x = 0 up to and in- 


cluding x® terms. 


. Find the Taylor series expansion of cos(5xz) about « = 1 up to and in- 


cluding (a — 1)° terms. 


. Find the Taylor series expansion of «* + 2x + 1 about x = 0 up to and 


including «* terms. 


. Find the Taylor series expansion of «* + 27 + 1 about x = 1 up to and 


including (a — 1)* terms. 


il 

Find the Taylor series expansion of — about x = —1 up to and including 
aa 

(2 + 1)® terms. 


Find the Taylor series expansion of . about « = 1 up to and including 
(2 — 1)® terms. : 

Solve y’ — x? = y? by series expansion. 

Solve y’ — e* + sin y by series expansion. 

Solve y” + ry’ + y = 0 by series expansion. 

Solve y’ = x+ ce y(0) = 1 by series expansion. 

Solve y’ = x? + y?, y(1) = 1 by series expansion. 

Solve y” +y=1+a2+27, y(0) =1, y’(0) = —1 by series expansion. 
Find a series solution for the ODE xy” — y = 0, which has a regular 
singular point. 

Find a series solution for the ODE 2x7y” + 3xy' — (x + 1)y = 0, which 
has a regular singular point. 

Find a series solution for the ODE xy” + x(x + 1)y’ — y = 0, which has 
a regular singular point. 

Find a series solution for the ODE 2x7y” + xy! + (a? — 1)y = 0, which 
has a regular singular point. 

Find a series solution for the ODE zy” + y’ + y = 0, which has a regular 
singular point. 

Find a series solution for the ODE (x? + 2°) y” — (a? +2)y' +y = 0, which 
has a regular singular point. 
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Chapter 8 Projects 


Project 8A: Asymptotic Series [6] 

There will be times when the method of Frobenius fails and we need to 
consider other approaches in our attempts to find series solutions to a 
given differential equation. Consider 


xy” + (1+ 32)y' + y = 0. (8.67) 


Show that there is an irregular singular point at 0. Even though the 
method of Frobenius should only work at regular singular points, let’s 
try it here. By assuming a solution of the form y = Sl a,2"t", show 
that the indicial equation is r = 0. By substituting into (8.67), show 
that the coefficients satisfy a@n41 = —(n + l)an, n = 0,1,2,--- and thus 
Gn, = (—1)"n!ao. Conclude that one solution is thus 


yi =a )_(-1)"nla”. (8.68) 
n=0 


Now comes the strange part. Show that this series has a radius of con- 
vergence of zero and thus diverges for all x 4 0. Since we assumed that a 
Frobenius series should have a non-zero radius of convergence, this means 
that (8.67) actually has no Frobenius series solution! 

We often focus on series that converge; that is, a series that approaches 
the exact function as we add more and more terms. In the remainder of 
this project we will consider an asymptotic series, which has the property 
that it approaches the function at a specific point even though it is a 
divergent series. In summary, if f,(a) is the partial sum approximation 
to f(x), then 


Convergent Series: lim Tl@) = f@), 


Asymptotic Series: lim dale) = 7 (@o). 
xr—->Xo 


For two functions f(a) and g(x), we use the notation 


f(z) ~ g(x), & > Xo 


to mean that the relative error between f and g goes to zero as > 2 
and 
f(z) < g(x), «> Xo 


to mean that f(x)/g(x) goes to zero as « + xo. Our solution (8.68) is an 
asymptotic series solution to (8.67). We now outline how we can obtain 
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a second solution. Substitute y = e° into (8.67) to obtain 
x9" + 27(9’)? + (1+ 3z)S’ +1=0. (8.69) 


Near an irregular singular point, it is usually the case that x7’ can be 
neglected relative to x?(S’)? and that 3275’ can be neglected relative to 
S’. We thus can write 


z7(S')?+5'+1~+0, £30". 
Solve this quadratic for S’ and conclude that (because x is small) 


ml, #0", 

So=27, c= 0". (8.70) 
Integrate both of the above asymptotic relations. The first gives the 
solution already obtained. Use the result from the second integration to 
conclude that the controlling factor in the leading behavior is governed 


by e!/*. To find the full leading behavior, substitute S(2) = «—! + C(a) 
(with C(x) « x~') into (8.69) to obtain 


oO" +27(C')? —(1—32)C’ —2 > +150. 
We can again neglect certain terms as x — 0* and obtain 
c(g)4+n = 0, 20. 
Solve this and conclude that the full leading behavior is given by 


-1,l/e 


= - 
Yo = Cor ,@£>0". 


Choose an initial condition and verify, by numerically solving (8.67), 
that y; + y2 agrees with this solution for small x. 


Project 8B: Hypergeometric Functions 


We will examine solutions of the differential equation 


a(1—a)y" +[e—(a+b+ 1)aly’ — aby =0, 


for |x| < 1 satisfying the initial condition, y(0) = 1. 
To do so, we first state two helpful definitions. The first uses the gamma 
function, I'(a), seen earlier in this chapter. We define 


(a), I(a+n) = iaueslasaiaiaaa n> 


T(q) il, ns 
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With this definition of (a), we can define the following: 


DEFINITION 8B 
Let a, b, and c be real numbers, and suppose c is a nonnegative number. 
Consider 


on the open interval (—1,1). The series is a real analytic function called 
a hypergeometric function. 


THEOREM 8B 
The hypergeometric function, F(a,b;c;x), is the unique real analytic 
solution to the hypergeometric differential equation 


O7y 


a(1—2) 5 +[e—(a+b4 ee! 


Ox 


aby = 0 (8.71) 


for |x| <1, satisfying the initial condition, y(0) = 1. 


Prove this by letting y(x) = 772, aja? with ag = 1. It may help you 
to make the observation 


(n+ 1)(@+n)ongi = (a+ n)(b+ nan. 


Show that the indicial roots of Equation (8.71) are r; = 0 and rp = 1~c. 
Using the Frobenius method with the root r; = 0, obtain a series 
solution for (8.71). 


Appendix A 


An Introduction to MATLAB, 
Maple, and Mathematica 


This is meant as a crash course in MATLAB®, Maple, and Mathematica or 
brief refresher. All have fairly friendly “help” menus which the reader should 
consult when questions arise that are not answered here. All three packages 
also have Student Versions available for about the price of one hardback text- 
book. Typically, MATLAB is used for numerical problems, whereas Maple 
and Mathematica are used for symbolic manipulation. We will see throughout 
the text that this distinction is often blurred. 


Computer laboratories in gray boxes (such as this) are given at the end of 
each chapter and provide code that will help the reader solve problems within 
the given chapter. 


Initially, we want to plot functions of one variable. Sometimes this will be 
an explicit representation as in y = f(a). But enough times the separation of 
variables process (or other method) leaves us with an implicit representation 
that can be written as f(z,y) = c. In order to plot solutions for either case 
we need to specify initial conditions. As we will see, MATLAB, Maple, and 
Mathematica have methods for handling this. 


A.l MATLAB 


This code was written using MATLAB R2014a. Certain code, particularly 
in the Symbolic Math Toolbox, may not work in earlier versions. 


In MATLAB, we execute the commands by either (i) typing them at the 
command line prompt >> and pressing <Enter> or (ii) typing the commands 
in a script, saving the script, and then executing the script by typing the 
name in the command window and pressing <Enter>. (Note that you DO 
NOT type in >> for any of these commands.) You cannot go back and 
correct a line that you typed. However, you can type in the correct one and 
re-execute it. For example, 
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>> x=0:1:5 
>> y=x2 


gives the error 


?7? Error using _*% 
Inputs must be a scalar and a square matrix. 
To compute elementwise POWER, use POWER (.”) instead. 


and you need to retype (or use the up arrow to recall the line) and then correct 
it as 


>> yex.42 


and the last line is the one MATLAB will use until you redefine or clear the 
variable. On occasion, it may confuse variables if you rename them multiple 
times. The commands 


>> clear y 
and 
>> clear all 


will wipe the memory clean of the variable y and then of all variables. 

As we saw above, we will proceed with the command window input. An 
important thing to realize is that everything in MATLAB is a matrix. If 
you have not yet encountered this word in your study of mathematics, just 
think of a matrix as a structure with both rows and columns. A vector is 
just considered a matrix of either one column or one row. And a scalar is 
considered to be a matrix with exactly one row and one column. 

Another main thing to remember about MATLAB is that you have the 
choice of putting a semicolon “;” at the end of each line or of not putting 
one. Putting the semicolon suppresses the output, whereas not putting the 
semicolon shows you the results of the statement you just executed. It does 
not matter whether you put a semicolon after a statement that plots or does 
something to an already existing plot. The MATLAB commands given in 
this text will be in typewriter font. Anything that follows a percentage sign 
“%” is ignored by MATLAB. MATLAB is also case sensitive. That is, the 
variables t and T are two different variables. Variables also continue to be 
defined/hold a value until we overwrite them or clear them. 

We again note at this point that if you type something incorrectly and get 
an error message, you can use the up and down arrows on the keyboard to 
scroll through previous commands that were entered. Sometimes an error 
is because of a simple typo and using the up arrow to recall your previous 
command and then correcting the mistake is often quite time saving. Also, 
if you entered something wrong, you cannot cut the error from the command 
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window—you can only execute the correct command and remember that the 
most recent assignment of a variable is the one in MATLAB’s memory. 

If we want to plot the function y = f(x) we need to know the x-values that 
we are going to plug into our function. Then we need to evaluate the function 
at these values. Sounds simple enough, right? Let’s try to plot f(2) = 2? —2x 


between the xz-values of —2 and 2. 


>> x=-2:.01:2; 
>> y=x.3 -x; 
> plot(x,y) 


The first line can be read as “go from « = —2 to x = 2 in steps of .01.” The 
step size of .01 was more or less arbitrary but will give us a smooth plot. The 
second line can be read as “take the entire vector x and cube each entry and 
then subtract the corresponding entry of x from this.” Remember z is a vector 
(or a matrix) and it doesn’t make mathematical sense to cube a vector—we 
really just want to cube each entry. The “.” is used to tell MATLAB to do an 
operation elementwise and this applies to multiplication, division, and raising 
to a power. (Addition and subtraction are always done elementwise.) If we 
want to label the axes, title the graph, and change the x-y values that we see 
in the window to, say, x € [—7/2,7/2] and y € [—2, 2], we could do so with 
the commands 


>> xlabel(’x’); 

>> ylabel(’y’); 

>> title(’Plot of f(x)=x’3-x’); 
>> axis([-pi/2 pi/2 -2 2]); 


We could also do things like plot the graph in a different color or super- 
impose another graph on it. Suppose we wanted to also graph the function 
f(x) = x? — 1 in the color green and on the same graph. We could use the 
commands 


>> yiex.%2 -1; 

> hold on 

>> plot(x,yl,’g’) 

>> title(’Plot of x3-x and x2 -1’); 
>> hold off 


A.1.1 Some Helpful MATLAB Commands 


MATLAB has a help section that can be accessed with the mouse or the 
keyboard. If you know the command you want to use but forget the proper 
syntax, the keyboard version is probably the way to go (e.g., if you want 
to know how to use the built-in MATLAB function ode45, you would type 
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help ode45 and information would appear in the command window). We 
summarize the commands in the list below. 


help <command> - specify a command and the info about it will be given 
lookfor <topic> - specify a topic and all commands that have related topics 
will be listed 

who - lists current variables 

cd amssi - changes the working directory to amssi (assuming it exists) 

pwd - tells you which directory you are currently working in 

dir - lists files in that directory 

clear all - clears variables from memory 

format long - lets you see more non-zero digits 

size(x) - gives the size of the variable (matrix) x 

length(x) - gives the length of the vector x 

zeros(n,m) - an n x m matrix of zeros 

ones(n,m) - an n xX m matrix of ones 

eye(n,m) - the n x m identity matrix 

rand(n,m) - an n x m matrix whose entries are random numbers uniformly 
distributed in (0,1) 

randn(n,m) - an n x m matrix whose entries are random numbers normally 
distributed with mean 0 and variance 1 

linspace(x1,x2,n) - a vector with uniformly spaced points whose beginning 
value is x1 and the last value is x2 with a total of n points 


A few other useful commands are the common function: exp, log, sqrt, 
cos, sin, tan, atan, and others. The Help menu in the top right of the 
window can help you find others. 


Plotting in MATLAB 
MATLAB gives numerous options for plotting. Some of the more often used 
ones are given here. 


figure - creates a new graph window 
orient tall, orient portrait, orient landscape - orients the picture 
in the desired manner for printing (portrait is the default) 


Various line types, plot symbols, and colors can also be implemented in 
MATLAB with the command plot (x,y,option) where option is a charac- 
ter string made from one element from any or all the following three columns: 
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y yellow : point - solid 

m magenta fe) circle : dotted 

c cyan x x-mark -. dashdot 

r red + plus -- dashed 

g green s square p pentagram 
w white d diamond * star 

k black v_ triangle (down) < triangle (left) 
b blue “triangle (up) > triangle (right) 


As an example, plot(x,y,’m+:’) plots a magenta dotted line with a plus 
at each data point, whereas plot(x,y,’bd’) plots a blue diamond at each 
data point but does not connect the points with a line. 


The reader is encouraged to go through the following example in detail, 
making sure that the syntax of each line is understood. 


Before getting into a detailed example, we pause to discuss MATLAB’s 
subplot command. In the previous code, we graphed a function that used 
the entire figure window. There will be many times when this is an inefficient 
use of space and we would like to restrict ourselves to a smaller portion of the 
screen. For example, suppose we want to plot 2 and «° separately so that we 
can see how they appear separately and then plot them together. We can do 
this conveniently with subplot. 

The command subplot simply divides the figure window into smaller sub- 
windows and then plots what follows in the given smaller window. The syntax 
for it is 

subplot (m,n,p) 

where m, n, p are positive integers. Ifm, n, p are single digits, i.e., 0 <m, 
n, p< 10, then we could also use the syntax subplot(mnp). The figure is 
divided into m (horizontal) rows and n (vertical) columns. The p refers to 
the figure and the numbering starts with 1 as the top left picture. One of 
the beauties of subplot is that we can mix and match how we divide up the 
window as long as there is no contradiction. See Figure A.1 for two examples 
of this and the next example for an implementation of subplot. 

If we wanted to superimpose figures, whether using subplot or not, we use 
the command hold on to tell MATLAB to superimpose everything that fol- 
lows until we tell it to hold off for the given figure (or subfigure). Example 
1 now illustrates some of these additional tools. 


Example 1: Basic commands and built-in functions. 
>> pitexp(1)+log(4) 

>> format long 

>> pitexp(3)+log(1/2) 

>> x=-2:.1:pi/2; 

>> eql=x.%2-1+sin(x); 

>> plot(x,eq1) 
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(2,2,1) (2,2,2) 83) |) G32) |] 3,3) 


(3,1,2) 


(2,1,2) 
(3,2,5) (3,4,11)) |(,4,12) 


(a) (b) 

FIGURE A.1: Two examples of the subplot command. In (a), we could 
obtain two plots on top by dividing the figure into 2 rows and 2 columns and 
then obtain one plot on the bottom by dividing the figure into 2 rows and 1 
column. In (b), we again divide up the picture so that it is consistent. E.g., 
we obtain the middle strip by dividing the picture into 3 rows and 1 column 
(with the middle strip being picture 2) and we could obtain the lower right 


one by dividing the picture into 3 rows and 4 columns (with the bottom right 
one being picture 12). 


>> plot(x,eqi,’b--’, ’LineWidth’ ,3) 

>> xlabel(’x’,’Fontsize’,12), ylabel(’y’,’Fontsize’ ,12) 
>> legend(’x’2-1+sin(x)’) 

>> title(’A basic plot’) 

>> axis([-2 pi/2 -1.5 1.5]) 

>> f=sqrt(x+2)+log(x+2); Znote that log(x) is 1ln(x) in MATLAB 
>> plot(x,f) 

>: plot tx,eq1,°b=".x5f 5? ms) 

>> xlabel(’x’,’Fontsize’,12), ylabel(’y’,’Fontsize’ ,12) 
>> title(’Superimposed plots’) 

>> legend(’x’2-1+sin(x)’, sqrt (x+2)+log(x+2) ’) 

>> axis([-2 1 -1.5 2]) 

>> x=0:.1:3; 

>> eq2=log(x) ; 

>> eq3=exp(-x.’2); 

>> plot(x,eq2,’b’) 

>> hold on 

>> plot(x,eq3,’k--’) 

>> xlabel(’x’,’Fontsize’,12), ylabel(’y’,’Fontsize’ ,12) 
>> axis([0 3 -2 2]), title(’In(x) vs exp(-x‘2)’) 

>> hold off anything that follows will not be superimposed 
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>> orient tall %makes picture take up full page when you print 


Unlike in Maple and Mathematica, worksheets are not saved for future ex- 
ecution by default. To save your input in a file, try examining the commands 
diary on and diary off to see their usefulness. Alternatively, all the com- 
mands may be stored in an m-file to be executed. 


There are many toolbores that can accompany MATLAB. Although it is 
not necessary for the reader to have access to any of these in order to use 
many of the numerical capabilities mentioned here and throughout the text, 
the Symbolic Math Toolbox is often helpful as it will allow symbolic manip- 
ulation. For example, we will be able to solve for the roots of a polynomial 
or calculate a “nice” form of a basis of the nullspace of a matrix. The reader 
may or may not find it worthwhile to purchase this particular toolbox. 


Example 2: Some commands that use MATLAB’s Symbolic Math Toolbox 
>> clear all 

>> syms x 

>> £(x)=x%44+2*x%3-84x/2 

>> £(3) 

>> subs (f(x) ,x,3) 

>> eql=solve(f (x) ,x) 

>> eqi(4) 

>> factor (f(x)) 

>> g(x)=1-x’%2 

>> f(x) *g(x) 

>> factor (f (x) *g(x)) 

>> £(x)/x 

>> simplify (f(x) /x) 

>> h(x)=x2+2*x+4 

>> solve (h(x) ,x) 

>> eq2=solve (h(x) ,x) 

>> eq2(1) 

>> real(eq2(1)) 

>> imag(eq2(1)) 

>> 2#iteq2(1) 

>> eval (2*iteq2(1)) 

>> eqt=x4+34x2-7#xt6 

>> solve(eq1) 

>> %~Next 2 lines find roots numerically w/o Symbolic Math Toolbox 
>> p=[1 0 3 -7 6] % Coefficients of polynomial 
>> roots(p) 
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A.1.2 Programming with a script and a function in MAT- 
LAB 


The use of a script allows one to create functions or simply store a set 
of commands to be executed. One needs to be careful to save a script to 
the appropriate directory and/or be in the right directory in the command 
window. A script is simply a text file that MATLAB knows to execute 
because it has the extension ‘m’. Clicking on File+New-— script will pop up 
a new window in which you can type. 

The easiest use of a script is to simply enter a list of commands that would 
normally be entered in the command window. E.g., we could create a script 
called ExampleA1.m and enter the following commands: 


x=-2:.01:2; 

y=x.3 -x; 

plot (x,y) 

xlabel(’x’); 

ylabel(’y’); 

title(’Plot of f(x)=x’3-x’); 
axis([-pi/2 pi/2 -2 2]); 
yi=x.%2 -1; 

hold on 

plot(x,y1,’g’) 


In the command window, we would then type 
>> ExampleAt; 


and the result would be the same we obtained at the beginning of this ap- 
pendix. That is, it would plot the function x? — x and x? — 1 on the same 
graph and with the various colors, axes, etc. specified. Alternatively, we could 
execute the file by clicking on the green arrow in the top middle of the Toolbar 
in the script window. 

A more important use of a Script is to create lines that have nested loops. 
Next we use a Script (or equivalently a Function) to plot the Taylor series 
expansion of sin(x) about « = 0 and compare with the actual function. More 
specifically, our function will take two numbers, N and «1, as inputs where 
N +1 is the number of terms in the expansion and «1 is the interval over 
which we will compare the function with its series expansion. Let’s call this 
file SineTaylorSeries.m. In a Script or Function, we would enter: 


Example 3: 


function f=SineTaylorSeries(N,x1) 
“This function takes two inputs N and x1. It compares the Taylor 
expansion of sine with (N+1) terms to the actual sine over 
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fythe interval [-x1i,x1]. 


x=-x1:0.1:x1; 

SinePlot=zeros(size(x1)); 

for k=0:N 

SinePlot = SinePlot + (-1)*k*x.’ (2*k+1)/factorial (2*k+1) ; 
end 

plot(x,SinePlot, ’b’) 

hold on 

plot(x,sin(x),’r+’) 

hold off 

end 


and save the file as SineTaylorSeries.m. Then, in the command window we 
could enter 


>> SineTaylorSeries (2,3) 
>> SineTaylorSeries (3,6) 
>> SineTaylorSeries(8,10) 


We close this part by noting that it is not necessary that the variable use in 
the script agree with the variable use in the command window. The use 
of m-files will be very important in the implementation of the Runge-Kutta 
method given in the book. 


Exercises 

The remainder of this lab will make use of many MATLAB commands, in- 
cluding zoom, fzero, sqrt, subplot, axis, format long, legend, xlabel, 
ylabel, title. Turn in both the commands that you entered as well as the 
output /figures. Please highlight or clearly indicate all requested answers. 


1. Enter the commands given in MATLAB Example 1 and submit both your 
input and output. 


2. Enter the commands given in MATLAB Example 2 and submit both your 
input and output. 


3. Enter the commands given in MATLAB Example 3 and submit both your 
input and output. 


A. Determine which of e” or m® is the larger value. Use format long to 
write your answers correct to 12 decimal places. 


5. Determine which of sin(In(v.7)) or In(sin(V.7)) is the larger value. Use 
format long to write your answers correct to 12 decimal places. 


6. Plot y=sin2z, — 3a <a < 3a dotted and red. Label the axes. 
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7. 
8. 


9. 
10. 


wd. 
12. 


13. 


14. 


15. 


16. 


17. 


18. 
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Plot y = (1—2)?—2, —1< a <3 dash-dot and cyan. Label the axes. 


Plot y=tanz, — 4 <2 < & with blue points. Label the axes. 
y ’ 2 2 


Plot y= en? —5 <a <5 solid and magenta. Label the axes. 


Plot « = Int, .1<¢< 5 and only show z-values from —3 to 2. Label the 
axes. 


Plot « = Vt,0 <t< 4 and use title and legend. Label the axes. 


Use subplot to plot y = sinz,sin2xz,cosx,cos2%, —2m7 <a < 27 in four 
different subfigures (in the same window). 


Ley = sin (2) on 0.1 <2 <10in 


Superimpose the plots of y = tan~ = 


the same figure. 


Superimpose the plots of y = sinz,y = cosx on 0 < x <7 in the same 
figure with a stepsize of .01. Use zoom to approximate the intersection 
point to 4 decimal places. 


Use fzero to find the intersection point of y = sinz,y = x? — 1 on 
0 <a < 2/2 to 8 decimal places. (Hint: To find the intersection of sin x 
and cosa at 52/4 we could type fzero(inline(’sin(x)-cos(x)’),4) 
(where 4 is an initial guess “close” to the intersection point) and the 
intersection point would be displayed numerically). 


Use fzero to find the intersection point of y = tanz,y = x? + 1 on 
3m <a < 77/2 to 8 decimal places. (Use the hint above.) 


We know from Calculus that the Taylor expansion of cosz about x = 0 
is given by 
x x4 a =o" 
cose =1- at =) op for |a| < co. 
k=0 

Write a Function or Script in MATLAB that will take N, x7, and x2 
(respectively, the number of terms in this expansion and the interval of 
comparison [x1, «2]) as inputs and will compare the actual function value 
with its approximation. Use the interval [0,67] and compare the actual 
function with its expansion of 6 terms, 15 terms, and 30 terms (3 separate 
plots). Limit your viewing window on the vertical axis to [—1.5 1.5]. 


From Calculus, we know that the infinite series 


ie a Bee 
i~k 2°30 4° 5 6 


diverges. Write a MATLAB Function or Script that will calculate the 
first N terms of this series. Run the code for N = 100, 1000, 10, 000. 
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19. Find the roots of «? + 3a +2. 


20. Find the roots of x? + 3” + 4. 
21. Find the roots of 2x? — 3a + 4. 


22. Find the roots of x? + 4x7 + 4. 


23. Find the roots of x? + 3a + 4. 
24. Find the roots of a + 2”? + 1. 


25. Find the roots of 7* + 2x? +5. 


26. Find the roots of #4 + 22? +a —5. 


A.2 Maple 


The code in this book was written using Maple 18 in Worksheet Mode. 
Certain code may not work in earlier versions. 


In Maple, we execute commands by entering them in the command window 
and pressing <Enter>. Any errors that were made can be corrected on the 
same line that they were typed. For example, the input 


Coe +1; 

gives the error 

Error, unable to match delimiters 

and we can click with the mouse on this same input line and correct it as 
(x? +1); 


and the command will be executed after we press <Enter>. In earlier versions 
of Maple or in the Classic Worksheet, every line needed to be ended with a 
semicolon; this is not the case in the Maple Worksheet. However, it is still 
the case that ending a line with a “:” will suppress the output. 

Maple is a powerful tool for symbolically solving equations and manipulat- 
ing them. We can integrate, differentiate, solve differential equations exactly, 
apply various techniques from linear algebra, and much more. We note that 
Maple 10 allows for entering objects such as fractions and integrals from a 
palette but since earlier versions of Maple do not have this feature, all code 
here is entered only from the keyboard. 
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In Maple, it is a good idea to always start your sessions by typing restart on 
the first line. If funny things start happening, you can go back to the beginning 
and re-execute everything, the first line clearing the Maple memory. To assign 
a variable a value, we use a “:=” instead of just an “=”. It is often useful to 
assign each line a name so that you can refer to it later. One common way is to 
label them eq1, eq2, etc. (even if you technically have an expression instead 
of an equation). The exception for labeling statements is for any command 
that plots. If you label one of these, it will return the calculated points and 
not the desired plot. Sometimes this is desirable but most of the times it is 
not. 

Anything following a “#” is ignored by Maple. Maple is also case sensitive. 
That is, the variables t and T are two different variables. Also, typing ’ will 
automatically go to a superscript whereas typing _ will cause everything that 
follows to be a subscript. Variables also continue to be defined/hold a value 
until we overwrite them or clear them. In contrast to MATLAB, if you execute 
a command and want to go back and change it, you can go and correct the 
line where the error occurred or where the change is desired. Once this is 
re-executed, the new value is the one in Maple’s memory. 

While everything in Maple can be entered with keyboard input, students 
usually find the Expression palette easier to navigate. We assume that here. 
Finally, when multiplying two things, we can use the palette to generate the 
“.” or equivalently just type “*” and the “-” will appear. 

If we want to plot the function y = f(x) we need to know the z-values 
that we are going to plug into our function. Let’s try to plot f(x) = «3 —2x 
between the xz-values of —2 and 2. We first click on f := a — y in the Ex- 
pression palette and then replace the a with x and the y with our function. 
The result will be the first line below; the second line plots the function. 


fi=xoxe-2 
plot( f(a), = —2..2) 


If we want to label the axes, title the graph, and change the x-y values that 
we see in the window to, say, x € [—7/2,7/2] and y € [—2, 2], we could do so 
with the commands 


T 7 


plot (f(x), =—-= 


a gy = —2..2, labels = |x, y], title =" Plot of {(x)=x"3-x" ) 


We note that the fraction 5 was entered using the Expression palette (for 
the fraction symbol ¢) and the Common Symbols palette (for the symbol 
a). We could also do things like plot the graph in a different color or super- 
impose another graph on it. Suppose we wanted to also graph the function 
f(x) = x? — 1 in the color green and on the same graph. We could use the 


commands 
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g:i=a>a*-1 
plot ( (f(x), g(a)],2 = ait = —2..2, labels = [x,y], color = [red,green|, 


title =" Plot of f(x)=x’3-x and x2 -1") 


A.2.1 Some Helpful Maple Commands 


Maple also has a help section that can be accessed with the mouse or the 
keyboard. If you know the command you want to use but forget the proper 
syntax, the keyboard version is probably the way to go. Suppose the command 
you have questions about is the solve command. In the Maple window, you 
could enter ?solve to open the help page for this command, you could enter 
??solve to see the syntax for this command, or you could enter ???solve to 
see some examples of this command in use. 


Some commands that you might use are: 
simplify, expand, evalf, evalc, allvalues, eliminate, coeff, diff, Diff, 
exp, fsolve, lhs, rhs, plot, roots, solve, subs, sqrt, assume, combine, 
mtaylor. There are also commands for linear algebra and vector calcu- 
lus including Eigenvectors, Eigenvalues, Jacobian, Transpose, Matrix, 
SubMatrix, Multiply, Trace, MatrixInverse, Row, Column. 


This list is not exhaustive but the commands frequently come up in compu- 
tations. There are also numerous options for plotting and the reader is again 
referred to the help menu for instructions. Some of the above commands, as 
well as others that are not on the list, require a specific Maple package to 
be loaded first. Four of the common packages that we will take advantage of 
are plots, DEtools, LinearAlgebra, VectorCalculus. E.g., we load the 
linear algebra package by typing with(LinearAlgebra): and note that it’s 
usually best to end the line with a colon. If we ended with a semicolon in- 
stead, we would see all the commands that are included in this package. If we 
are just beginning, this may be helpful but after a while it’s not necessary to 
see these all the time. See the help menu for instructions on using the various 
commands and additional packages. 


Example 1: 
Some basic commands and examples of plotting in Maple. 
Pi + exp(1) + In (4) 

3 1 
m+e?+In (5) 
#The Pi symbol above is from the Common Symbols palette; for the e? first 
go to Expression palette and click on a’, then highlight the a and click on e 
in the Common Symbols and then highlight the b and type 3; the ln is also 
entered from the palette 
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1 
{eval (Pi + exp(1) + In (4)), evalf (= +e? +In (5) ) \ 
eqi := 2* —1+sin(z) 
plot (cat, a -2..5) 
plot (cat, = — 2.559 = —1.5..0.5, thickness = 4, labels = [x,y], 
labelfont = [12,12], color = blue, legend = [’x/2—1+sin(x)"], linestyle = 
3, title =" A basic plot ") 
f:= «a> Vx+24In(a+2) #Entered from Expression palette, f :=a— y 
plot (f (a) ,@ = —2..1) 
plot ({eq1, f (x)],a = —2..1,y = —1.5..2, labels = [x, y], color = 
[blue, maroon], legend = ["x*2-1+sin(x)” ,"sqrt(x+2)+In(x+2)" J, 
linestyle = [1,2], tétle = "Superimposed plots” ) 
with(plots) : 
eq2 := plot (In (a), a = 0..3,y = —2..2, linestyle = 1, color = blue) 


eq3 := plot (ea = 0..3, y = —2..2, linestyle = 3, color = black 
display ([eq2, eq3], title =" In(x) vs. exp(-x"2)") 


Example 2: Solving algebraic equations. 
restart 

f := 2 442-032-827 #The - is from the Expression palette or typed as * 
f (3) 

subs (a = 3, f(a)) 

soll := solve (f (x) ,x) 

soll [4] 

roots (f (x)) 

factor (f (x)) 

gi=a>1-2 

f (x) -g (2) 

factor (f (x) - g (#)) 

expand (f (x) +g (x)) 

f(@) 


x 
simplify (42) 

a 
hi= a ta?+2-c+4 
sol2 := solve (h(x) ,x) 
sol2{1] 
Re (sol2[1]) 
Im (sol2[1]) 
2-7+ sol2(1] #Enter i from expression palette or type as I 
evalc (2-i + sol2[2]) 
eqi := 24+3-27-7-2+6 
eq? := solve(eq1) 
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allvalues(eq2[1]) 

evalf( allualues(eq2[1])) 

[evalf( allvalues(eq2[1])), evalf( allvalues(eqg2[2])), evalf( allvalues(eq2[3])), 
evalf( allualues(eq2|4]))] 


A.2.2 Programming in Maple 


We can also write code in Maple. This is often done with a procedure. 
One thing to keep in mind when writing these, Maple keeps track of what 
is global and what is local. Any intermediate computations that are done 
are not saved nor can they be displayed. Thus if you need an intermediate 
computation for later, be sure to declare it as a global variable. 


Example 3: Create a procedure in Maple that approximates sina by its 
Taylor series about x = 0. The procedure takes N and «x1 as inputs, where 
N is the number of terms in the expansion and the comparison between sin x 
and its Taylor series will be done over [—21,x1]. 


restart; 
#when entering the code below(from the line containing proc until the 
line containing end proc), you must use “Shift-Enter” to go to the 
next line! 

Sine TaylorSeries := proc(N, r1) 

local SinePlot, k; 

description "this function compares the Taylor expansion plot of sine about 
x=0 to the actual function” ; 
# This procedure takes N,x1 as inputs. Nis number of terms in the 
expansion of sin(z) about t=0 with the comparison over [-«1, x1]. 

SinePlot := 0; 

for k from 0 to N do 


(- 

Plot := Plot + ——___— 

SinePlo SinePlot + @-k+1)! 
end do; 


plot([SinePlot, sin(x)],« = -r1..41, color = [blue, red], style = [line, point]) 
end proc: #now you may finally just click “Enter” 
SineTaylorSeries(2,3) this will compare the (2+1) term Taylor expansion 


of sine over [-8,8] 
Sine TaylorSeries(3, 2) 
Sine TaylorSeries(3, 6) 


)R ght 


One final comment: the reader should also be aware of the difference be- 
tween the various palettes and their typed versions. For example, if we type 
pi and subtract from it the symbol 7 from the Common Symbols palette, 
that is, pi—7, the answer does not simplify; however, Pi—7z simplifies to 0. A 
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similar thing happens for Greek letters spelled out vs. entered from the Greek 
palette: Gamma—I does not simplify but GAMMA—T simplifies to 0. 


Exercises 

The remainder of this lab will make use of many Maple commands, including 
plot (using options such as title, color), solve, subs, evalf, simplify, 
rhs. Submit only the answers and output requested to the problems given 
here. (Remember that you can write over an incorrect Maple command and 
re-execute it, thus saving lots of space due to typos/errors.) Highlight or 
clearly mark the answers that you are asked to provide. 


1. Enter the commands given in Maple Example 1 and submit both your 
input and output. 


2. Enter the commands given in Maple Example 2 and submit both your 
input and output. 


3. Enter the commands given in Maple Example 3 and submit both your 
input and output. 


4. Determine which of e” or 7° is the larger value. Use Digits:=15 to 
write your answers correct to 12 decimal places. 


5. Determine which of sin(In(/.7)) or In(sin(V.7)) is the larger value. Use 
Digits:=15 to write your answers correct to 12 decimal places. 


6. Plot y=sin2z, — 3a <2 < 3a dotted and red. Label the axes. 
7. Plot y=(1—2)?—2, —1< <3 dash-dot and cyan. Label the axes. 


8. Plot y=tanz, — 4 <a < 4 with blue points. Label the axes. 


9. Plot y= en? —5 <a <5 solid and magenta. Label the axes. 


10. Plot x = Int, .1<¢<5 and only show z-values from —3 to 2. Label the 
axes. 


11. Plot « = Vt,0<t<4 and use title and legend. Label the axes. 


12. Superimpose the plots y = sinz,sin2x,cosxz,cos2x on — 207 <a < 20 
in the same figure. 


13. Superimpose the plots of y = tan~! x,y = sin (4) on 0.1 <2 <10in 
the same figure. 


14. Superimpose the plots of y = sinz,y = cosz, 0 < x < m in the same 
figure. 


15. Use fsolve to find the intersection point of y = sinz,y = x? — 1 on 
0 <a < 7/2 to 8 decimal places. 


16. 


17. 


18. 


19. 
20. 
21. 
22. 
23. 
24. 
25. 


26 
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Use fsolve to find the intersection point of y = tanz,y = v7 +1 on 
30 < a < 77/2 to 8 decimal places. 


We know from Calculus that the Taylor expansion of cosz about x = 0 
is given by 


Write a procedure in Maple that will take N, x1, and x2 (respectively, 
the number of terms in this expansion and the interval of comparison 
[c1, t2]) as inputs and will compare the actual function value with its 
approximation. Use the interval [0,67] and compare the actual function 
with its expansion of 6 terms, 15 terms, and 30 terms (3 separate plots). 
Limit your viewing window on the vertical axis to [—1.5 1.5]. 


From Calculus, we know that the infinite series 


ee ee ae, 
ak eB a BB 


diverges. Write a Maple procedure that will calculate the first N terms 
of this series. Run the code for N = 100,1000,10,000. Now use the 
Maple command sum and calculate the same 3 sums. 


Find all roots of 7? + 3a” +2. 
Find all roots of 7? + 3” +4. 
Find all roots of 2”? — 3” + 4. 


Find all roots of x? + 4x + 4. 


Find all roots of x? + 3a + 4. 
Find all roots of a + 2a? + 1. 


Find all roots of a4 + 2a? +5. 


Find all roots of a4 + 2a? +a —5. 


A.3 Mathematica 


The code in this book was written using Mathematica 10. Certain code 
may not work in earlier versions. 
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In Mathematica, we execute commands by entering them and holding down 
<Shift> and then pressing <Enter>. Unlike MATLAB and the Classic Work- 
sheet version of Maple, there is no command prompt (so just start typing). 
Any errors that were made can be corrected on the same line that they were 
typed. For example, the input 


y [x-]=x2+1; 
gives the error (click on the “+” in the box to the right) 


” 


Syntax::sntxf: ”y[x-” cannot be followed by ”]”. More... 


and we can click with the mouse on this same input line and correct it as 
y [x_J=x2+1; 


and the command will be executed after pressing <Shift> <Enter>. 

Mathematica is comparable to Maple in its ability to symbolically solve 
and manipulate equations (both are quite good). We can integrate, differenti- 
ate, solve differential equations exactly, apply various techniques from linear 
algebra, and much more. 

In correcting input lines, Mathematica’s kernel (i.e., computation engine) 
sometimes gets confused. When this happens, you should go up to Kernel 
—> Quit Kernel —> Local or simply type Quit[] and then re-execute the 
relevant commands. If your line ends with a semicolon “;” then the output is 
suppressed. If your line has nothing then the output is shown. To assign a 
variable a value, we use “=” unless it is a function. For functions we must type 
the variable name followed by an underscore as in the first example above. It 
is often useful to assign each line a name so that you can refer to it later. One 
common way is to label them eqi, eq2, etc. (even if you technically have 
an expression instead of an equation). Plots can also be labeled, too, which 
helps when you want to superimpose various plots. 

Anything inside (* *) is ignored by Mathematica. Mathematica is also case 
sensitive. That is, the variables t and T are two different variables. Variables 
also continue to be defined/hold a value until we overwrite them or clear them. 

If we want to plot the function y = f(x) we need to know the z-values that 
we are going to plug into our function. It is often useful to enter the equation 
first to make sure there are no typos and then ask Mathematica to plot it. 
Let’s try to plot f(x) = x3 — x between the x-values of —2 and 2. We could 
enter this equation with the keyboard only as 


£[x_]=x’3-x 


but it’s often easier to enter it using the palette as 
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f[x_]=x°—x 
Plot (f [x] ,{x,-2,2}] 


The first line defines the equation as a function of the variable x and can 
be read as “f is the function defined as x? — x,” while the second line says to 
plot the function f [x] from « = —2 to x = 2. Note that the underscore was 
needed to define the function but not when it was referred to at a later step. 
If we want to label the axes, title the graph, and change the z-y values that 
we see in the window to, say, x € [—7/2, 7/2] and y € [—2, 2], we could do so 
with the commands 


Plot [f[x], {x, — o zh. PlotRange—{—2,2}, AxesLabel > {”x”,”y”}, 
PlotLabel + Plot of f(x) = x®— x”) 


We can also do things like plot the graph in a different color or superim- 
pose another graph on it. Suppose we wanted to also graph the function 
f(x) =x? — 1 in the color green and on the same graph. 


glx_]=x?-1 
Plot [{f|x], g[x]}, {x, -3, 5} , PlotRange+{—2, 2}, AxesLabel—{”x”,”y”}, 
aaa — {Blue,Green},PlotLabel > ”Plot of x*—x vs. x?—1”] 


A.3.1 Some Helpful Mathematica Commands 


Mathematica has a help section that can be accessed with the mouse to 
find many commands and the proper syntax to use them. Some commands 
that you might use are: Simplify, FullSimplify, Expand, N, 
ReplaceAll, Coefficient, D, E, Solve, NSolve, NDSolve, Plot 
FindRoot, ExpandAll, Series, Eliminate, Integrate. There are also 
commands for linear algebra including Eigenvalues, Eigenvectors, 
Eigensystem, CharacteristicPolynomial, Row, Column MatrixForm, 
LinearSolve, Tr, Det, Transpose. 


This list is not exhaustive but the commands frequently come up in com- 
putations. We can sometimes enter a command in two different ways—with 
the keyboard or with the palette. E.g., Integrate can be used or we could 
click on the integral sign. There are also numerous options for plotting and 
the reader is again referred to the help menu for instructions. Additional 
commands may be available by loading a specific Mathematica package. 
We refer the reader to the help menu for instructions on using the various 
commands and additional packages. 

The reader is encouraged to go through the following example in detail, 
making sure that the syntax of each line is understood. 
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Example 1: Some sample commands from Mathematica. 


m+ e+ Log/4] (*entered from palette*) 

N(Pi E*1+Log[4]] (*entered from keyboard*) 

Nir+et+ Logl4l (*gives a decimal answer*) 

eqt [x_]=x? ae | 

Plotleq1[x ], {x,- 

Plot [eqi[x], {x, — a PlotRange—{—1.5, 1.5}, AxesLabel—{”x”,”y”}, 
oe Dotted, Thick}, PlotLegends—” igpredaione? ; 
PlotLabel—>”A basic plot”| 

flx_J= /x+2+4+Log|x+ 2] 

Plot [f[x] ,{x,-2,1}] 

Plot [{eq1[x], f[x]}, {x, —2, 1}, PlotRange—-{—1.5, 2}, AxesLabel—{”x”,”y’}, 
PlotStyle—{{Blue, Dashed, Thick}, {Magenta, Thick}}, 
PlotLegends—>” Expressions” , PlotLabel—” Superimposed plots”] 

eq2[x_] = Plot[Log|x], {x, 0,3}, PlotRange—{—2, 2}, PlotStyle—{Blue}] 

eq3[x_] = Plot le, {x, 0, 3}, PlotRange—+{—2, 2}, 


PlotStyle—{Black, Dashed, Thick}| 
Show|eq2[x], eq3[x],PlotLabel— ”1n(x) vs. exp(—x?)”] 


Example 2: Solving algebraic equations with Mathematica. 


Quit|](*open bracket, close bracket, no space*) 

f[x J=x*+2x?-—8x? 

(*Note: multiplication is done with ‘*’ or with a <Space>*) 
£[3] 

ReplaceA11[£ [x], x3] 

Sol1 = Solve[f[x] == 0,x] (*‘double equal’ is needed for solving*) 
So11|[4]] 
$o11{[4]][[1]] 
Roots|f [x] = 
Factor[(f|[x]] 
g[x_]=1-—x 
fx] ale 
Factor|f [x] g[x]] 
Expand[f [x] g[x]] 


= 0,x| 


£[x| 

“= 

FullSimplity| =] 

h[x J=x?+2x+4 

So12 = Solve[h|x] == 0, x] 
So12|[1]] 


Sol2a = $012([1]{[1]]((2] 
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Re[Sol2al 

Im[Sol2a] 

2i+Sol2a (*i entered from palette*) 
eqi(x_] =x*+3x?-7x+6 

eq2 = Solve[eqi[x] == 0, x] 

Nieq2] 


A.3.2 Programming in Mathematica 


We can also write code in Mathematica. This is often done with functions 
and various combinations of For-statements, if-statements, etc. We will use 
“:=” to tell Mathematica that the rhs will be the delayed value assigned. 


Example : Create functions using Module in Mathematica that approximates 
sin x by its Taylor series about x = 0. You should create a function that takes 
N and x1 as inputs, where N +1 is the number of terms in the expansion and 
the comparison between sin x and its Taylor series will be done over [—x1,xI]. 


Quit] 

SineTaylorSeries[N_, x1_] := Module|{k, eh 
SinePlot[x_] = 0; 
For[k = 0, k < N, k++, 

(—1)kx2k+4 

(2k + 1)! 
Plot [{Sin[x], SinePlot[x]}, {x, -x1, x1}, 
PlotStyle— {Blue, {Red, Dashing[Tiny] }}]] 

SineTaylorSeries [3,6] 

SineTaylorSeries [2,3] 

SineTaylorSeries [8,10] 


SinePlot[x_] = SinePlot[x] + a 


Exercises 

The remainder of this lab will make use of many Mathematica commands, 
including Plot, Solve, NSolve, FullSimplify. Submit only the answers and 
output requested to the problems given here. (Remember that you can write 
over an incorrect Mathematica command and re-execute it, thus saving lots 
of space due to typos/errors.) Highlight or clearly mark the answers that you 
are asked to provide. 


1. Enter the commands given in Mathematica Example 1 and submit both 
your input and output. 


2. Enter the commands given in Mathematica Example 2 and submit both 
your input and output. 
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14. 


15. 


16. 


17. 
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Enter the commands given in Mathematica Example 3 and submit both 
your input and output. 


Determine which of e” or 7°’ is the larger value. Use Digits:=15 to 
write your answers correct to 12 decimal places. 


. Determine which of sin(In(V.7)) or In(sin(V.7)) is the larger value. Use 


Digits:=15 to write your answers correct to 12 decimal places. 
Plot y = sin2x, — 3a <2 < 3m dotted and red. Label the axes. 
Plot y = (1—2)?—2, —1< a <3 dashed and magenta. Label the axes. 


Plot y=tanz, —4<2a< % with blue points. Label the axes. 
y , 2 2 


Plot y= en? —5 <a <5 solid and green. Label the axes. 


. Plot x = Int, .1 <t< 5 and only show z-values from —3 to 2. Label the 


axes. 


. Plot x = Vt,0 <t< 4 and use title and legend. Label the axes. 


. Superimpose the plots y = sinz,sin2z,cosz,cos2x on —2m7 <2 < 20 


in the same figure. 


. Superimpose the plots of y = tan7!az,y = sin (4) on 0.1 <2 <10in 


the same figure. 


Superimpose the plots of y = sinz,y = cosz, 0 < x < m in the same 
figure. 


Use NSolve to find the intersection point of y = sinz,y = 2? — 1 on 
0 <a < 7/2 to 8 decimal places. 


Use NSolve to find the intersection point of y = tanz,y = x7 +1 on 
3m <a < 7r/2 to 8 decimal places. 


We know from Calculus that the Taylor expansion of cosa about « = 0 
is given by 


Write a function(s) in Mathematica that will take N, x1, and 22 (respec- 
tively, the number of terms in this expansion and the interval of compari- 
son [xz1, 72]) as inputs and will compare the actual function value with its 
approximation. Use the interval [0,67] and compare the actual function 
with its expansion of 6 terms, 15 terms, and 30 terms (3 separate plots). 
Limit your viewing window on the vertical axis to [—1.5 1.5]. 


18. 


19. 
20. 
21. 
22. 
23. 
24. 
25. 
26. 
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From Calculus, we know that the infinite series 
eee 
Hk 253° 4°5 6 


diverges. Write a function(s) in Mathematica that will calculate the first 
N terms of this series. Run the function for N = 100, 1000, 10,000. Now 
use the Mathematica command Sum and calculate the same 3 sums. 


Find all roots of 2? + 3” +2. 


Find all roots of 7? + 3a +4. 
Find all roots of 2x? — 3a + 4. 


Find all roots of 7? + 4a 4+ 4. 


Find all roots of 7°? + 3” +4. 
Find all roots of a + 2a? + 1. 


Find all roots of a4 + 2a? +5. 


Find all roots of «* + 2%? + x —5. 
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Appendix B 


Selected Topics from Linear Algebra 


B.1 A Primer on Matrix Algebra 


This section is a concise introduction to matrix algebra. We assume no 
prior knowledge of matrices. 

As a motivation, we consider a system of two first-order differential equa- 
tions 


dx 


Ge TO + By 
dy 

— = —A4¢ + Ty. 
di x+ Ty 


We want to find a compact way to write and ultimately solve this system. We 
can write the coefficients of the variables in a rectangular array. For reasons 
we will see shortly, the way we do this is 


dx 
dt| _[-5 8] /2 
dy |  |—-4 7] ly] 


We say that 


are vectors and 
—5 8 
[=a | 
is the coefficient matrix of our original system of equations. If we are not 
dealing with differential equations, the left-hand side may be constant but we 
can still write our system in the form of vectors and matrices. 


Simply put, a matrix is a rectangular array of numbers. The horizontal 
lists are called rows, and the vertical lists are called columns. For example, 


let 
23 +44 
A=|5 1 nF 
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This matrix has two rows: [2 3 4] and [0 il — 2]. It has three 


2 3 4 
columns: la: Hi and El 


We refer to the size of a matrix as its number of rows by its number of 
columns. A 2 x 3 matrix (read “two by three matrix”) is a matrix with two 
rows and three columns. Although we sometimes will talk abstractly about 
vectors, for now when we say vector, we mean the traditional understanding 
as a matrix with either one row or one column; a vector with only one row is 
called a row vector, and a vector with only one column is called a column 
vector. Our concepts of vector spaces (see Section 5.3) apply to these 
“vectors” as well. 

We frequently need to refer to specific elements of a matrix, and we use 
the row and column information to provide an address for each element. For 
example, the ijth element is the element in the ith row and the jth column 
(rows are always listed before columns). Thus we denote a generic matrix by 


a1 a12 aoa Ain 

21 a22 Sra An 
A — 

Gm1 Gm2 ses) Amn 


or more succinctly by A = (ai;)mxn- We call a matrix square if the number 
of rows is equal to the number of columns. 

Matrices can be considered to be a number system much as the integers, 
the real numbers, or the complex numbers are number systems. As with other 
number systems we define ways to add, subtract, multiply, and divide matri- 
ces. Thus we construct an algebra for matrices which we call, appropriately 
enough, matrix algebra. We again note that a vector (in the traditional mul- 
tivariable calculus context) is simply a matrix with only one column or one 
row and thus the statements about matrices apply to vectors as well. Two 
matrices can be added provided that they have the same size; thus two 2 x 3 
matrices can be added together, but a 2 x 3 cannot be added to a 3x5 matrix. 
Addition and subtraction are defined elementwise. Thus A + B = C means 
that for alli and j, cj; = aij +b;;. Similarly A—B = C means cj; = aj; — bj;. 


For example 
a b ee f| [ate b+f 
c d g h\| |jetg d+h|’ 


@ 6) |e J| |\a—e =f 
c d g hl} |e-g d-h|- 
In algebra on the real numbers, 0 is a distinguished number called the 
additive identity. This means that for any real a,a+0=aand0+a=a. 


There is a matrix (for each size of matrix) playing this same role for matrix 
arithmetic. It is called the zero matrix and is the matrix consisting of all 


B.1. A Primer on Matrix Algebra 685 
zeros, and denoted by O. It is easy to verify that 
A+0=0+A=A. 


There are actually two number systems involved in matrix algebra: the ma- 
trices themselves and the elements that make up the matrices. We distinguish 
these by calling the former matrices and the latter scalars. Technically the 
1 x 1 matrix (a) is a matrix, while a is a scalar. Whenever feasible, matrices 
are denoted by capital letters and scalars are denoted by lower case letters. 
We occasionally need to multiply scalars and matrices together. If s is a scalar 
and A is a matrix, we define a new matrix sA to be the matrix that results 
from multiplying all the entries of A by s. Thus if B = sA, then bj; = saj;. 


For example, 
a b| _|sa_ sb 
|" “| ~ |< we 

Multiplication in matrix algebra is, in general, much stranger than multi- 
plication in the real numbers. While the multiplication by a scalar that we 
just defined is similar to addition and subtraction of matrices, there is a major 
conceptual difference. Multiplication of a matrix by a scalar is the multipli- 
cation of two different types of objects, namely, scalars and matrices. It is 
useful to define a multiplication between two matrices. But first we consider 
the special case of multiplying a matrix and a vector. If we consider an m x n 
matrix, the vector we consider must be of size n x 1. It is perhaps most con- 
sistent to consider the multiplication of a matrix A and a vector x as a linear 
combination of the columns of A. The idea of a linear combination is the 
same as that used in Section 3.2 in which we combined solutions of a linear 
equation and the result was still a solution of the same linear equation. Here, 
the equivalent statement is that we take a linear combination of the columns 
(of size m x 1) of A and end up with a vector (still of size m x 1) that is in 
the column space of A (see Section 5.2 for further discussion of this). For 
example, 


1 2 3 2 1 2 3 
4 5 6 1 |] =2-)4)/41-]5/ —-1-)6 
7 8 9} |-1 it 8 9 

1 

=} 

13 


In order to be able to use the rows of the vector x as coefficients used to take 
linear combinations of the columns of A, it is essential that the number of 
columns of A be equal to the number of rows of x. Thus, we have the rule 


Am xnXnx1 = Pmxi; (B.1) 
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which governs the size of the matrices and vectors that we can multiply 
together. In general, we have 


G11 G12 «+. Gin Ty Q11 a12 Gin 
G21 G22... G2n 2 a21 a22 a2n 
=2) 2 | rt] 2 | bee tan 
Ami Am2 +--+ Amn In aml Am2 Amn 
©Q11 1 22412 T*** + LMnGin 
© Q21 + ©2492 T*'* + UnG2n 


L1Am1 + L2Am2 +++ + InGmn 


by 
= he (B.2) 


bmn 
This is simply an alternate way of writing this system of m equations in n 
unknowns and we refer to the matrix A in such situations as the coefficient 
matrix of the linear system. 
When we consider multiplication of two matrices, AB, we can easily think of 


doing matrix vector multiplication, with the vectors x of the previous matrix- 
vector multiplication now being the columns of B. Let 


A = (Giz mon and B = (bi3 )nxp- 


We can think of the resulting columns of C,,., = AB as 


a11 a12 Qin 
a21 a22 a2n 

cy = by; ; + ba; tet bnj : (B.3) 
aml Am2 Amn 


In terms of multiplication by the elements of the matrices, each entry, c;;, of 
the product C = AB is defined by 


Cig = A41b17 + Aigbaj + +++ + Girbr;- 


In a sense what we have done is multiply the ith row of A by the jth column 
of B. For the 2 x 2, we have 


a b\||}e ff] Jae+bg af+bh 
c d||g h|  |ce+dg cf+dh}|- 


You can multiply matrices of different sizes, but the number of columns of the 
matrix on the left must equal the number of rows of the matrix on the right: 


cr 34-375 


B.1. A Primer on Matrix Algebra 687 


Another way of viewing multiplication of matrices, AB, is A acting on the 
columns of B: | | | | | 


AB=A]|b, bo ... bp| =|Ab, Abo ... Ab,|. (BA) 
| | | | | | 


We could use this to show a few nice rules for matrix multiplication: 


Matrix multiplication is associative: A(BC) = (AB)C = ABC, 
A(B+C)=AB+AC, 


Matrix operations are distributive: { (B+C)D =BD+CD. 


However, matrix multiplication does not commute in general: AB #4 BA. 


The specific example 
1 2}/0 1} ]2 1 
3 4}/1 O}] [4 3]? 


O 1}J/1 2] [3 4 
tolls al-[i al: 
shows that the order of the matrices when we multiply does make a difference. 

After you have practiced multiplying some matrices, you should become 
convinced that, while more complicated than real number multiplication, ma- 
trix multiplication is not very hard to do. Despite not being very hard, it is 
cumbersome and not very pleasant if the matrices are large and many need 
to be multiplied together. Matrix multiplication for large matrices is ideal for 
a calculator or computer. Indeed many calculators and software packages are 
able to perform matrix multiplication, and we assume that you have access 
to one and have mastered its use from this point on. 

In what follows, we frequently need to multiply a matrix by itself repeatedly. 
The analogous notation from real number multiplication carries through. The 
product AA is written A?, AAA is A®, and in general the product of n copies 
of A is A”. 

While dealing with notation for powers of matrices, we should mention the 
transpose operation. The transpose of a matrix is a new matrix which is 
the same as the old except the rows and columns have been switched. The 
transpose of an m X n matrix is then an n xX m matrix. The notation for the 
transpose of A is A’. We always use a capital T for transpose. 


|Example 1:| The transpose of the following two matrices is calculated here. 


4 3 9 T —1 2 
2-9 4) “|e = 
2 A 
and = 
=). 3 1 —2 8 2 
5 1 4 = | 
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We note that the transpose can also be useful to simplify the typesetting. 
When referring to a column vector, we usually write it in transposed form 
T es ; : 
[v1 22... Xp] . Since the transpose flips the rows and columns, repeating 
this process will give us our original matrix: (A7)? = A. Multiplying two 
matrices and taking the transpose of the result is equivalent to doing the 
transpose of each matrix but with the order switched: 


(AB)? =BTA?. (B.5) 


We can also define two numbers associated with a given square matrix. The 
trace of matrix 


a b 


Tr(A) = k ‘| =at+d. 


That is, the trace is defined as the sum of the (upper left to lower right) 
diagonal elements of a matrix. In terms of notation for an n x n matrix A, 
we can write 


Tr(A) => S- ajj. 
g=1 


Further, there is a number associated with a matrix called its determinant. 
The determinant of a matrix is a very useful theoretical tool that comes up 
in many different places in this book. The determinant of a 2 x 2 matrix 


a b 
a=[e al 
is ad—cb. Often straight vertical lines are used to denote a determinant. Thus 


det(A) = 


[= ad ob 


We present two methods of calculating the determinant of a 3 x 3 matrix. 
The first is easier to use but does not generalize to higher dimensions, while 
the latter is sometimes harder for the student to grasp but extends easily to 
larger square matrices. 

For the first way, we write the first two columns of A as a 4th and 5th 
column: 


abea£@b 
de fd e. 
g high 


We then proceed in an analogous way to the 2 x 2 case. That is, we begin at 
the top left, going down the diagonal and multiplying the entries. We repeat 
this for the next two entries in the first row. Then we subtract off the reverse 
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diagonals beginning with the first row, 3rd column entry and moving to the 


next two: 
Subtract these products = —gec — hfa — idb 


Add these products = +aei + bfg + cdh 
Then the formula for the 3 x 3 case is 
det A = aei + bfg + cdh — gec — hfa — idb. 


The second approach for a 3 x 3 matrix also holds for larger square matrices: 
expansion-by-minors. To expand on the first row, we take the entry in the 
(1,1) position, multiply by (—1)'*1, and multiply it by the determinant of 
the matrix that remains when we cross out the first row and first column 
(called a minor); then add to it the entry in the (1,2) position, multiplied 
by (—1)'*?, and multiplied times the determinant of the matrix obtained 
by crossing out the first row and second column; then add the (1,3) entry 
mulitplied by (—1)!*3, and multiplied times the determinant of the matrix 
obtained by crossing out the first row and third column. For example, if 


abe 
A=]de f 
g h i 
then 
_ je f d f d e 
det(A) = a hi -»|° ,| +e an 


= aei — ahf — bdi + bg f + cdh — cge, 


which is the same formula obtained with the other method of calculation. 
Observe that this method is a recursive definition since the determinant of 
a 4x 4 matrix involves computing four determinants of 3 x 3 matrices, each 
of which requires the computation of three 2 x 2 matrices. Here we defined 
expansion on the first row. We can expand on any row or column in the same 
way as described above with the sign changing as (—1)'t/ where (i,j) is the 
position we are. We direct the reader to any introductory matrix algebra book 
for details or for other methods of computing a determinant. 


| Example 2: | Find the determinant of each matrix. Use the first method to 


find |B| and the second method to find |C}. 
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Solution 
We apply the relevant definitions of the determinant from above: 


|AJ=1-2-0-3=2, 
0 2 8 


3 0 0 
=> |B) =3+0+0-0-2-(-8)=9 


5 4 3 4 35 
= 1(12 — 5) — 2(8 — 3) + 3(10 — 9) = 0. 


iol =1]5 1 2 1 2 | 


j-2|s als 


Before moving on, we state (without proof) a few useful properties of the 
determinant 


Some Properties of det(A) 


1. if A has 2 rows (or 2 columns) that are equal, det(A)= 0 

. det(A”) =det(A) 

. det(AB)=det(BA)=det(A)det(B) 

. det(cA) = c’det(A) for an n x n matrix 

. exchanging two rows (or two columns) in A changes the sign of 
det (A) 

6. subtracting m times row 7 from row 7 has the same determinant as 

the original matrix 


oo Fe WwW 


This last point will be useful for Gaussian elimination, covered in Section 5.2. 

The last operation we consider at this time is the inverse. The motivation 
comes from high school (or earlier!) but is useful for putting the current 
discussion in its proper context. When working with the real numbers we 
have both 2 and 5. Mas know these numbers are multiplicative inverses of 


each other because 2 x 5; = 1 and 4 x 2 = 1. In an abstract algebra course, 


we express the fact that 4 is the multiplicative inverse of 2 by writing it as 


2-1. Similarly 2 = ae Here the symbol “— 1” can be interpreted either 
as physically inverting the number, or as the abstract inverse, i.e., 27! is 
the number which when multiplied by 2 gives 1. If you have not thought 
about it before, notice that all division can be expressed as multiplying by 


a multiplicative inverse. This is the idea that is carried over into matrix 
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multiplication. The symbol I will denote any square matrix (same number of 
rows as columns) with ones on the diagonal and zeros elsewhere and is called 
an identity matrix. For example, the 3 x 3 identity matrix is the matrix 


1 0 0 
I= ;0 1 0 
0 0 1 


This matrix plays the role of “1” in matrix multiplication and it’s an easy 
calculation to see that det(I)= 1. You should verify that 


AI=A 


and 
JA=A. 


Because of this, the identity matrix is frequently called the multiplicative 
identity. The inverse of a matrix A is denoted by A~!. The matrix A7! 
is defined to be the matrix such that AA~' =I and A~'A =Tif it exists. If 
you followed the discussion about 2 and $, then you should see this as exactly 
analogous. The existence of A~! is an issue. By the way A! is defined, it 
needs to be multiplied by A on both sides, so A has to be a square matrix 
for A~? to exist. A definition and theorem help us at this point. 


Definition B.1.1 

Let A be an n x n matrix. 

a. If det(A) 40, then A is said to be nonsingular (invertible). 
b. If det(A) = 0, then A is said to be singular (noninvertible). 


Although we mentioned determinants at an earlier point, they tie in nicely 
here. 


THEOREM B.1.1 
Suppose A is an n x n matrix. Then A~! exists if and only if A is 
nonsingular. 


Determining if the inverse of a matrix exists is a straightforward, tedious 
calculation. Finding the inverse of a matrix is a non-trivial, though also com- 
pletely algorithmic, process. It is also computationally expensive and thus 
not usually calculated in practice unless necessary. We put the discussion of 
techniques for finding one by hand in Appendix B.2. As with matrix multi- 
plication, computing inverses is not usually done by hand, and the packages 
of MATLAB®, Maple, and Mathematica are quite capable of doing these 
computations. The computer labs at the end of this appendix show how to 
compute matrix inverses with the computer. 
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|Example 3:| Determine whether each matrix is singular or nonsingular: 


1 3 1 4 0 1 2 3 
A=|5 |i B=]-2 3 1], CH 2) 3 
0 2 1 3.5 4 

Solution 


From the previous example, we calculated 
|A| =2, [BJ=9, [Cc] =0 
and thus Definition B.1.1 lets us conclude that A,B are nonsingular whereas 


C is singular. 
a 


We will learn how to calculate inverses in Section B.2 but we give the 
inverses here to illustrate their use. In the previous example, the inverses of 
A and B are 


i —4 4 
At=3)9 fal B=. o 2 ‘st 
=A =F 1 


Multiplication shows that AT'A =I= AA7!: 
1}/2 —3]}]1 3 1/2 0 L- “Q 
| ae + = 
a*a=5/5 1 |[o al=alo al=[0 1 


and similarly 
AA = E | 


We can similarly show that B~! is indeed the inverse of B. 
A few other miscellaneous properties for an n x n matrix (where we assume 
A, B are both nonsingular): 


1. det(I)=1 
DA eee aX 

=i il =i 
3. det(A~*) sum det (A) 
4. (AB)-! =B-1A7} 
SCA =f = Ae 


Property (4) can be remembered with the socks-shoes analogy: If A is the 
action “put on your shoes” and B is the action “put on your socks,” then AB 
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applied to your foot, x, can be thought of as put on your socks Bx and then 
your shoes A(Bx). The inverse of this is take them off, which you must do in 
reverse order. With y as your foot with shoe and sock, you first take off your 
shoes A~'y and then take off your socks B~!(A~ty). 

Matrices can also be used to succinctly write a system of linear equations. 
For example, 


Q4121 + AyQ%2 + +++ + AinIn = by 
A212, + A22%2 +++: + Gant = be 
(B.6) 
Ani®1 + An2%2Q te Anntn = bn 
can be written 
Ax =hb, 
where 
a11 412 Gin al by 
a21 4922 a2n v2 bo 
A= , x= 2 15 and b=] | |. (B.7) 
Qnl1 an2 nad Ann In, bn 


We define R” as the set of all vectors with n real entries and thus x is a vector 
in R”. It is of great interest to find a vector x that will solve the system given 
a matrix A and a vector b. In terms of theory, the solution will exist and be 
unique when A~! exists and will be given by 


x= A-‘b. 

|Example 4:| ~ | Find the unique solution of the system 
x+3y=—-l 
2y=4 


by writing the system in matrix-vector form and computing A~'b. 


Solution 
We can rewrite this system in its equivalent matrix-vector form: 


ol }=[a) 


We saw previously that A7! exists and is given b 
y & y 


1f2 -3 
-l_ei 
. =5l5 ‘ul 


Thus the unique solution is given by 


c=are=3[o 7] [a] -[7]) 2 
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The reader may question why we would solve the system this way when 
we could just solve the last equation for y and substitute it into the other. 
The reason lies in the insight that we will be able to gain by considering 
the system in matrix-vector form. We will be able to deal with significantly 
more difficult systems with this same method and solving one equation for a 
variable and substituting it into another becomes a clumsy way (at best) to 
solve the system. 

We give an important theorem that summarizes some of the topics we have 
discussed: 


THEOREM B.1.2 

The following are equivalent characterizations of the n x n matrix A: 
a) A is invertible. 

b) The system Ax = b has a unique solution x for all b in R”. 

c) The system Ax = 0 has x = 0 as its unique solution. 
d) det(A) 4 0. 
e) The n columns of A are linearly independent. 


Although we leave the mechanics of calculating an inverse to Appendix B.2, 
we know whether or not an inverse exists simply by calculating its determi- 
nant. Solutions may exist, however, even when A~! does not exist. It is 
very computationally expensive to calculate the inverse of a matrix and this 
is never how a vector x is found. But writing the solution in this way is very 
useful for conceptually understanding what we are trying to accomplish. 


Geometry of Solving Ax=b 


In attempting to find an x that satisfies Ax=b for a given A, b, we could 
have three possible situations: unique solution, infinite solutions, or no 
solution. If we have either a unique solution or infinite solutions, we say the 
system of equations is consistent, whereas if there is no solution we say the 
system of equations is inconsistent. In terms of two variables, consider the 
following equations and their graphs in Figure B.1. 


x+y =4 3x — 3y = —6 -e+y=-l1 


(b) 


FIGURE B.1: (a) Consistent, unique solution; (b) consistent, infinite so- 
lutions; (c) inconsistent, no solution. 
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For two variables, the geometric interpretation of unique, infinite, or no 
solutions is easily seen. In higher dimensions where the number of equations 
is the same as the number of unknown variables, we are also concerned with 
finding the intersection of lines, but it is just harder to graph. Instead of the 
traditional graphing of the equations as given in Figure B.1, it will often be 
useful to rewrite the equations as Ax=b and consider the columns of A as 
the vectors. The equations of three pictures, which are redrawn in Figure B.2, 


then give us 
1 2} Jai} |4 
A [2}- [2] Bs) 
3 —3]]a1} _ |-6 
Bae esiaes Be 
—1l 1} jai.) f-l 
a] [e]-[2] a0 
In the first case, (B.8), we are then asking if there is a linear combination of 
—1 1 2 
of each other and thus are linearly independent. Thus, any vector in the 


two-dimensional space can be written as a linear combination of them and, 
consequently, we can obtain a unique solution to our system of equations. 


| : and i that will give the vector 2 . These vectors are not multiples 


Xx 


x; 


(a) (b) c) 
FIGURE B.2: (a) Consistent, unique solution because the vectors are lin- 
early independent; (b) consistent, infinite solutions because although vectors 
are linearly dependent, the vector [-6 2]” lies in the same line; (c) incon- 
sistent, no solution because the vectors are linearly dependent and vector 
[—1 2]7 is not in the same line. 


In the second system of equations, (B.9), we observe that ie and Be 


are multiples of each other. Thus, they can only give a solution that lies along 


2 
is an infinite number of solutions. 


In the third system of equations, (B.10), we have El and | and again 


one of the vectors. Since | | is a multiple of either of these vectors, there 
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observe that these are multiples of each other. However, because the vector 
-1 
2 
these vectors that will work. 
The interpretation of matrix-vector multiplication as taking linear combi- 
nations of the columns extends nicely to more equations as well. If we consider 
Ax =bDas 


is not a multiple of these, we can never find a linear combination of 


1 2 by 
4 3 ie by | , (B.11) 
3 1 


we would like to know if we can find a linear combination of the columns of A, 
1 2 
4} and | 3], that will give us b; see Figure B.3. The geometrical answer 
3 1 
is that b must lie in the plane that contains the two column vectors (and 
also includes the origin). We can equivalently say that it’s the plane of all 
possible combinations of the two column vectors (i.e., its the column space of 
the matrix). We revisit these last two examples in Section 5.2 after covering 
Gaussian elimination. 


FIGURE B.3: In order for there to be a solution to (B.11), b must lie in 
the plane that contains the two column vectors {1 4 3]” and [2 3 1]7. 


Problems 


In Problems 1-3, write the following systems using vectors and matrices. 


2 —~27=2 
ane = ie 
a x+4z =0 YS eee y 


In Problems 4-5, calculate (by hand) AB and BA for the following matrices. 


2 —-3 —2 2 
a=(7, P]e-[7 2] 
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i 2. =f . = 2 
RAHI = 4), Be/-L 1 -=6 
3 0 2 o 2 2 


In Problems 6-37, consider the following matrices: 


‘ 0 63 1 
1 5 2 a ae 
D=|-1 0 3]/,E=/5 1 1 
A 2B 4 2 @ A 


Compute the following expressions, when possible. If it is not possible, state 
why it is not possible. 


6.D+E 7.D-—E 8.2D + 3E 9.2A 
10.B+C 11. 4E — 2D 12. Tr(E) 13. Tr(B) 
14. Tr(3D) 15.Tr(D+C) 16. A7 17." 
18.D? +E7 19. A? 20. AC 21. DE 

22. ED 23. AB 24.BA 25. BA? 
26. EA 27. AE 28. ATE 29. ABC 
30. det(B) 31. det(D) 32. det(E) 33. det(B?) 
34. det(DE) 35. det(ED) 36. det(E)det(D) 37. det(D7) 


B.2 Matrix Inverses, Cramer’s Rule 


This section of Appendix B is essential if the course is to be used as a 
one-quarter course that combines linear algebra and differential equations, a 
one-semester course in differential equations that stresses the key influences 
of linear algebra, or if the reader seeks a deeper understanding of the theory 
of differential equations as seen in Chapters 3 through 5. If none of these 
applies, the reader may skip this material unless a brief review of Cramer’s 
rule (used for Section 4.5 on Variation of Parameters) is needed and this part 
of the current section is self-contained. 

We focus on a system of linear equations given as (B.6) and written in 
matrix-vector notation as 


Ax =b. 


We will typically be given a vector b in R™ and a matrix A in R™*” (that 
is, an m X nm matrix with real entries). Our goal will be to find a vector x in 
R” that will make the equation Ax = b a true statement. 

We make note of two areas of active research at this point. Many times, 
a mathematical model gives rise to a system that has more variables than 


698 Appendix B. Selected Topics from Linear Algebra 


equations, thus leading to an m x n matrix where m < n and both are 
large, say 50,000 x 100,000. Although the methods we learn in linear algebra 
apply, these kinds of matrices are usually best dealt with in the subject of 
optimization. Many other mathematical models of physical systems give rise 
to very large square systems, on the order of a matrix A that is 100,000 x 
100, 000. Although we will learn how to solve Ax = b by hand in this section, 
we clearly would not want to solve that large of a system by hand. What 
do we do? Interested students should take a course in numerical linear 
algebra and explore the wealth of algorithms that efficiently give us our 
desired solution. There is a tremendous number of unsolved problems in 
these areas and researchers (maybe even your professors!) are actively seeking 
solutions today. 


B.2.1 Calculating the Inverse of a Matrix 


The reader should be sure to be familiar with Section 5.2 and elementary 
row operations in order to follow this section. With this knowledge, we can 
now find the inverse of a matrix. How? Let us think what Gaussian elimina- 
tion accomplished for us. We began with 


Ax=b 


and reduced this to a system C=. 
where U is an upper triangular matrix and the b, denotes the vector b after 
we have performed the same elementary row operations that gave us U. Our 
answer is the vector x and we can also write the answer (if it exists, of course) 
as 

x= A 'b or equivalently x = U7!by. 


In a previous example, we considered Ax = b, where 


=F. 2 
A=|4 2 -4|, b=|-2 
oe 4°93 -2 


We reduced the system to row-echelon form, which can equivalently be written 
as 


a =| 
Ux=b,withu=|]0 1 2], bu=|] 1 
00 1 2 


We illustrate below how Gauss-Jordan elimination can also be used to give 
us the matrix inverses. For now, assume that we are able to calculate the 
inverses and in doing so we obtain 


,[5 4 -2 10 2 —1 
At=5 -4 -~3 2 |,orU7'=]0 1 —-2] withb,=| 1 
5 2 =I Oo 0 1 2 
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The reader should verify that in either case we end up with the desired solu- 
tion. 

In the above example, we were able to obtain A~', but this will not always 
be the case as mentioned previously. There are many examples in which our 
system cannot be solved with the use of our three elementary row operations. 
In this case, we say the system (or matrix) is singular and the inverse of 
A does not exist. Assuming that A~! exists, we were able to proceed with 
Gauss-Jordan elimination and end up with the system 


x=A'b. 


Thus the inverse of our matrix is related to the elementary row operations of 
Gauss-Jordan elimination. If we instead wrote our original system as 


Ax =Ib (B.12) 
and reduced this through Gauss-Jordan elimination to 
Ix = A~'b, (B.13) 


we would have the inverse of the matrix on the right-hand side. Note that 
we did not need to keep track of b in this case. Let us again consider our 
previous example given as (5.8) with coefficient matrix 


20 4 
A=|4 2 -4|. (B.14) 
2 4 2 


Instead of constructing the augmented matrix with b as a fourth column, we 
consider the matrix 


—2 G 4 10 0 
A=|4 2 -4 | 01 Of. (B.15) 
4 9 001 


According to our previous discussion, if we do Gauss-Jordan elimination 
on the left half while keeping track of the resulting effect on the right half 
of the matrix, our final answer will be the inverse of A. We will repeat the 
elementary row operations from above and will show all intermediate steps: 


=)-0- 4 |) 1. oO 0 

Ry —@2Ri) + hh ees |) De | (B.16) 
2 A201 0 O 4 
=9:0 a | 1. G 

R3—(-Ri) > R3 gives | 0 2 4] 21 0 (B.17) 
0 6 | 101 
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—2 0 4 1 0 0 
R3 —2R2 > R3 gives 0 2 4 2 1 0} (B.18) 
0 0 -2 -3 -2 1 
SR > Ri, $Rz > Ra, LY cs G 
-17, 4 Ra gi 0.1 2 1 $ 0 (B.19) 
oe 3 7 3 gives 0 0 1 2 il 3 
10 -2 + 0 0 
R2—2R3— Ry gives |0 1 0 —-2 3 14] (B.20) 
00 1 2 1 +3 
1 0 0 3 2 -1 
Ri —(-2R3) > Ri gives |0 1 0 -2 3 14]. (B21) 
001 2s 1 3 


The right half of this matrix is exactly the inverse of A as the reader should 
check. But that was a lot of work! Now you will perhaps understand why it’s 
not even desirable to calculate the inverse with a computer. Nevertheless, it 
IS instructive to understand the manipulations that are possible. In the com- 
puter lab, we give sample code that will do these elementary row operations 
and then the built-in commands that will do the same thing. 


|Example 1:| Find the inverse of the general 2 x 2 matrix. 


Solution 
In order for A~! to exist, we need det(A)¢ 0. If we assume the form 


a b 

cd" 
this means that ad — bc £ 0. Going through the steps of Gauss-Jordan elimi- 
nation gives 


a b 1 0 
k | - 4 B.22) 
c . a 0b 1 0 
Ry - a > Ro gives k f= be | =e i B.23) 
a a b 1 0 
Ry Ro gi og a B.24 
ad—be ” a tone k 1 ad—be or | 
1 be —ba 
R, — bR2 > Ri gives E : + ad-be al B.25) 
0 1 ad—be ad—be 
1 a 
-R, > Ri gives | a ad— be | , B.26) 
a 0 1 ad—be ad—be 
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Since each term of the inverse has the same denominator, we factor it out to 


give 
-1 
a b 1 d —bd 
‘ 4 ~ ad — be & a | , (een 


and we clearly see why we need ad — bc £ 0. 


| 
| Example 2:1 Find the inverse of a diagonal matrix, if it exists. 
Solution 
Ann x n diagonal matrix has the form 
di, Oe 
Oy geass G 
: . Pa (B.28) 
0 O--- dy 
with d; 4 0, 7 =1,--- ,n in order to have a non-zero determinant. We set up 
the augmented matrix 
d, 0 0 }1 0 0 
: da . 2 (B.29) 
0 0 d,|0 0 1 
and then perform one step (on each row) of Gauss-Jordan elimination: 
0 t 0 - 0 
ARR, ERR, [OT 00 ~~ OL ay 
ag godin Hg gives : ne oe ne 
0 Giee EQ Oca oF 


Thus, for a diagonal matrix in which none of the diagonal entries are zero, its 
inverse is obtained by replacing each diagonal entry with its reciprocal. 


B.2.2 Cramer’s Rule 


This section of the Appendix can stand alone from the rest, with the possible 
exception of Appendix B.1, which the reader may need to read parts of in order 
to take the determinant of a matrix. Cramer’s rule is really just another way 
to solve a system of equations. However, it 1s computationally inefficient to 
use Cramer’s rule for even moderately large systems, so we'll skip the theory 
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and just give the formulas for the 2x 2, 3x 3, and general nxn cases. We stress 
that Cramer’s rule only works with systems of n equations in n unknowns. 
In Section 4.5, we need to solve a system of equations and Cramer’s rule is a 
straightforward way to do this. Any of the methods of this section will work, 
too, but would be a bit more cumbersome because we may be dealing with 
functions instead of scalars as the entries in our matrices. 


Let us consider the 2 x 2 linear system 


ait + ayy = by (B.31) 
G21x + a22yU = bo. (B.32) 


Cramer’s rule states that the solution is 


by a2 ayy by 
bz a2 az, be 
£= , y= ‘ (B.33) 
Q11 412 a11 G12 
a21 422 a21 422 


Mechanically, we obtained the solution to the first variable by replacing the 
first column of the coefficient matrix by the right-hand side in the numerator 
(and then took its determinant) and divided by the determinant of the coeffi- 
cient matrix. We note that the denominator cannot be zero because otherwise 
our answer will be undefined or indeterminate. But the denominator is the 
determinant of the coefficient matrix, which is zero only when there is no in- 
verse. In this situation, the system either has no solution or possibly infinitely 
many solutions. In the case of a non-zero determinant, we will always be able 
to solve the system. 


For the 3 x 3 linear system 


ait + ay2Y + 4132 = by (B.34) 
ag1v + a22Y + 4932 = bo (B.35) 
A310 + a32Y + a332 = b3, (B.36) 


we again replace the first column of the coefficient matrix in the numerator 
by the right-hand side. For simplicity, let A denote the coefficient matrix and 
|A| its determinant. Then Cramer’s rule states that the solution is 


by a2 413 ayy by a3 ayy ay by 
bz a2 23 az, bz a3 a2, a22 by 
b3 32 33 a3, 63 a33 a3, 32 3 
x2 = —_, Y=,_ ZS (B.37) 


|A| 
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For the general linear system 


44121 + Ayg%q + +++ + Ann = by 
G2121 + A22%2 + +++ + dan%n = bg 

(B.38) 
Ani X1 + An2%Q + +++ + AnnLn = bn; 


we will again let A denote the coefficient matrix and Cramer’s rule can be 
stated as 


by a2 +++ Gin 
by ag2 +++ Gan 
where the first column in the 
by Gn2 +++ Ann numerator is replaced by b 
= : B.39 
Ly |A| ’ ( ) 
ayy by Ain 
a Pi a b Pin taf a n 
ea : . where the 7th column in the 
numerator is replaced by b 
Ani Th Dn or ann for 7 = 2,-:- n—-1l 
= , : : : B.40 
F A (B.40) 
Q11 412 by 
a21 422 0) 
ee GQnt Gn2 +7: dn where the nth column in the (B.41) 
nu |A| > numerator is replaced by b. : 
| Example 3: | If possible, solve the following system using Cramer’s rule: 
2% + 3y = 4 
—@+2y =5. (B.42) 
Solution 


In order to see if the system can be solved by Cramer’s rule, we need to 
calculate the determinant of the coefficient matrix: 


2 3 


l= |, 3 


=4-(-3)=7, 
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Because |A| 4 0, we can solve the system. Applying (B.33) gives 


| A 3 | | 2 : 
5 2 —7 -1 5 14 
STAR TAP 
a 

|Example 4:1 If possible, solve the following system using Cramer’s rule: 

27+ 3y=4 

e+2yt+z2=-5 
Ty +2z = —-6. (B.43) 


Solution 
In order to see if the system can be solved by Cramer’s rule, we need to 
calculate the determinant of the coefficient matrix: 


2 
Al ei 
0 


NIN WwW 


0 
1] = 2(4— 7) —3(-2-0) +0(-7—0) =0. 
2 


Because |A| = 0, we cannot use Cramer’s rule to solve the system. If we 
instead tried to solve the system by Gaussian elimination, we would obtain, 
after two steps of elimination, 


2 3 0 4 
0 7/2 1 -3]. (B.44) 
0 0 O 0 
This can be solved to give 
23 + 3z —6—2z : 
r= y= z = anything. 


7 a 


Thus we have infinitely many solutions for this system. 
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| Example 5:| If possible, solve the following system using Cramer’s rule: 
22 + 3y = 4 
—£+2y+2=-5 
3y — 2z = —4. (B.45) 


Solution 
In order to see if the system can be solved by Cramer’s rule, we need to 
calculate the determinant of the coefficient matrix: 


2 3 O 
jAj=l=0 2 1 |\=a-4-3)=30—0)40(-3— 0) = 90. 
0 3 -2 
Because |A| 4 0, we can solve the system. Applying (B.37) gives 
4 3 O 2 4 0 2 3 4 
-5 2 #1 -l1 -5 1 -1 2 -5 
—-4 3 -2 0 -4 -2 0 3 -4 
t= ? ? a= 
|A| : |A| |A| 
_-70 7 _ vo _, eid 4 
~ —20°° 2 ~ =—20 —20 2 
as the solution to our system. = 
e e e e e e e e e e e e 


Problems 


In Problems 1-6, determine which of the following 3 x 3 matrices are in row- 
echelon form. 


1 0 0 1 2 0 1 0 0 
1.;0 1 0 2./0 1 O 3./0 1 0 
0 0 1 0 0 0 0 2 0 
13 4 15 -3 12 3 
4.;/0 0 1 5./0 1 1 6.};0 0 0 
0 0 0 0 0 O 0 0 1 


In Problems 7-12, solve each of the following systems by Gauss-Jordan elim- 
ination. 


Qe, — Bay = —2 ae aan a 
{ Qn, +22 =1 8. —2, — 2%. +3273 =1 
321 = 7x2 ai 4x3 = 10 
22%; + 279 + 273 = 0 —2b+3c=1 
9. 2%, + 5x42 +273 = 1 10. ¢ 3a+6b—-— 3c = —2 
84, +2%9+ 473 = —-1 6a+ 6b4+ 3c =5 
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x—2y+4z=2 22 + 3y — 2z = 2 
11. ¢ 2a —-3y+5z =3 12. x—2y+3z=2 
30 —4y+7z=7 4x —y+5z=1 


In Problems 13-15, use Cramer’s rule to solve the following systems of equa- 
tions. You must evaluate the determinants by hand. (You may, of course, 
check your answer with the computer.) 


Be day aD a+4z =2 22 + 3y —2z = 2 
ES ple 14. Qe—3y =3 15.4 x—-2y+3z =2 
o— 3a — 4y + 6z =0 4a —y+4z =1 


In Problems 16-19, solve using (i) Cramer’s rule, (ii) Gauss-Jordan elimina- 
tion, (iii) built-in commands of MATLAB, Maple, or Mathematica. 


= 4x + 5y =2 
Wi iat: 17.2 lig+y+2z= 


eee tee e+5yt+2z2 =1 
4g +yte2tw =6 
xa—4y+z =6 30+ 7y-ztw =1 
of 4x—-—y+2z =-1 1 7x + 3y —5z+ 8w = —-3 
2@ + 2y — 3z = —20 crty+z+2w =3 


x =x2'cosd—y' sind 
y =2' sind + y' cosé 
for x’, y’ in terms of a and y. 


20. Use Cramer’s rule to solve { 


In Problems 21-26, find the inverse of the matrices using Gauss-Jordan elim- 
ination. If the matrix is 2 x 2, additionally find the inverse using the formula 
for a 2 x 2 matrix inverse. 


1 2 3-4 1 2 
21. fe 2 22. bi : | 23. E A? 
1 2 —-A4 1 3 -4 
24. | 1 5 25./-1 —-1 5 26./2 5 —-1 
3 -6 2 7 —3 3 13 —-6 
B.3 Linear Transformations 
In Section 6.1, we considered the equations 
dx 
aa! 
dy k 
— == B.4 
dt m ee) 
and 
dx 
a —dx + 8y 
d 
of dg Ty, (B.47) 
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and discussed how the vector field can be used to describe the motion of a 
trajectory (projection of the solution onto the x-y plane) through a given 
point (a, y). In the first system, Equation (B.46), we can write 


and thus view the right-hand side as “the coefficient matrix A multiplied by 
the vector H .” The result gives the instantaneous rate of change of the 


trajectory through that point. For example, if we consider the trajectory that 
passes through (1,2) (for, say, m = 2,k = 3), we find its instantaneous rate 


of change is 
—3 0} [2 -3 


and the motion of the trajectory is right and down as was shown in the picture 
of the vector field (see Figure 6.2). 


For the second system, Equation (B.47), we can again consider the trajec- 
tory through the point (1,2) and calculate the instantaneous rate of change 


; be Jp)-[3) 


Thus the motion of the trajectory is right and up and we again saw this in 
the vector field (see Figure 6.3). 


In both of these systems, multiplication of a vector by a coefficient matrix 
describes the slope of the solution through the given (x,y) pair. So we may 
think of a matrix doing something to or acting on a vector; this gives us a 
useful interpretation of matrix-vector multiplication. 


With this as our motivation, we will now consider some useful ideas from 
linear algebra. For the purposes of this section we adopt the viewpoint of A 
acting on a vector x. In the case of a square n x n matrix A, the vector x gets 
moved from one location in R” to another; geometrically, the vectors in R” 
have been moved according to the “action” of A, with perhaps some vectors 
(e.g., 0) being left unchanged. In the case of a rectangular m x n matrix 
A, we have a situation where A takes a vector from one vector space (R”) 
to another vector space (R™). Note that the origin in R” is mapped to the 
origin in R™. 
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| Example 1 The matrix-vector multiplication 


=) 3° 2 =1l 13 -1 3 2 0 0 
1 1 O 2/=); 1 and 1 1 0 0; = ;0 
2 -3 4 3 4 2 -3 4 0 0 


shows that a 3 x 3 matrix takes a vector in R® to a vector in R*, whereas 


-1 3 27/5 | [13] ana [-2 3 2] 16/ —[2 
PaO ey tah eS tt a Oh 18 


shows that a 2 x 3 matrix takes a vector in R? to a vector in R?. Note that 
in both cases, the origin was mapped to the origin (in a different space in the 


case of a rectangular matrix). “ 


Regardless of whether our matrix A is square or rectangular, our definition 
of matrix multiplication gives us the following: 


PROPOSITION B.3.1 
Let c,,¢c2 be any scalars, let x, y be vectors in R”, and let A be anm xn 
matrix. Then 

A(cix + cay) = c,(Ax) + co(Ay) (B.48) 


and we say A is a linear transformation. 


In this case, we say that A takes R” into R™. A matrix is one example of a 
linear transformation but there are many other examples. When the domain 
and range are the same space, as is the case when A is a square matrix, we 
say that A is a linear operator. 


| Example 2 | Let D denote the differentiation operator, d/dt, from Section 


3.1.1. D is a linear transformation that takes polynomials of degree n to 
polynomials of degree n — 1: 


D(ant” +++» +a t +49) = napt™ > +--+. (B.49) 
If x and y are polynomials then we can easily verify that 


D(c1x + ey) = c1(Dx) + c2(Dy). 
@ 


It is a natural question to ask, if all matrices are linear transformations, is 
it the case that all linear transformations can somehow be represented by a 
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matrix? The answer is yes (for n < oo) but we refer the reader to other texts 
for the details [47]. Here, instead, we focus on writing the above example in 
matrix notation and then examining linear transformations as matrix multi- 
plications, as this gives us geometrical insight into our problem. 


| Example 3 | In the last example it was shown that D is a linear transfor- 


mation; can we represent this linear transformation by a matrix? For a fixed 
nm < oo, consider a polynomial a,t” +---+ a,t+ ao, writing the coefficients 
of the powers as the entries in a vector x of length n+ 1 


c= . (B.50) 


ay 


Differentiation can be represented with the matrix 


0 0 0 0 0 0 

n 0 0 0 0 0 

0 n-1 0 - 0 0 0 
D=|90 0 m-2 --- 0 0 0]. (B.51) 

0 0 O -- 2 0 0 

0 0 -- 0 1 0 


For instance, consider the polynomial x(t) = 2t* — t3 + /2t? +t—1. Then 


0 0 0 0 0 2 0 
4 0 0 0 0 -1 8 
Dx=!/0 3 0 0 0 Jf/2|=]-3 |, (B.52) 
0 0 2 0 0 1 2/2 
00 0 1 0 -1 1 


and this last vector can then be rewritten as the polynomial 8¢? —3t?+2,/2t+1, 
which is the derivative of 2t4 — t2 + /2t? +t-—1. 


Some linear transformations with simple geometric interpretations 
Interpreting a linear transformation as a matrix that takes vectors from one 
space to another is often useful. We present four examples that have a con- 
crete geometrical interpretation. The vectors, as we will see, remain in the 
same space. For simplicity, we will consider vectors in the plane R?. 
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1. Stretch. In this situation, a vector is stretched (or shrunk) by a factor k. 
A matrix that will do this is one of the form 


0 & 


This matrix can be written more compactly as A = KI, where I is the 2 x 2 
identity matrix. We know that multiplication by the identity leaves things 
unchanged. Also, multiplication of a scalar k& times a vector (or matrix) 
requires us to multiply every entry by this factor of k. Thus kI will lengthen 
any vector by a factor of k if k > 1 (and will reverse the orientation and 
lengthen by a factor of k if k < —1) and will shorten any vector by a factor 
of k if0 <k <1 (and will reverse the orientation and shorten by a factor of 
k if -1<k <0). We have encountered this situation before with eigenvalues 
and eigenvectors. 


Jy Jy Jy 
; ky 
x x x 
kv 
k>1 


-1<k<0) 


FIGURE B.4: Vector v stretched by a factor of k. Note that the direction 
may change depending on the sign of k. 


|Example 4| ~ Recall that for a matrix A, the eigenvalue \ and eigenvector v 


satisfy 


A= fi HE (B.53) 


Av = Iv. 


In other words, A stretches v by a factor of X. < 


2. Rotation. In this case, a vector is rotated counterclockwise about the 
origin by some angle ¢. The matrix that will do this is of the form 


_ [cos —sing 
aie fe cos @ | j eed 


Consider the vector (1 0)”, which lies along the z-axis. If this vector through 
the origin is rotated through an angle of ¢ = 7/4 rad, the matrix simplifies to 


a—|i/v2 -lv2 
V2 1/2 


(B.55) 
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and thus 
ba ee ])-E-a0l-E2). os 


Recalling from multivariable calculus that the Euclidean length of a vector 
is the square root of the sum of the squares, we see that the resulting vector 
is again of length one. It should also be apparent that the vector is oriented 
at an angle of 7/4 rad. 


Jy Jy 
1}i 
0 $ 
xX xX 


FIGURE B.5: Vector [1 0]” rotated through an angle of ¢ = 7/4. 


| Example 5 | We consider the system 


dx 

—" = ar —b 

ie Ot — bY 

d 

7 = br +ay, (B.57) 


where a, b are real and b ¥ 0. In this situation the eigenvalues of the coefficient 
matrix A are \; = a+ib,A2 = a—ib. We saw in Section 6.1 that solutions 
were rotated because of the complex eigenvalues. We will not solve the system 
now but simply want to examine the right-hand side Ax, where x = (x y)’. 
If we use polar coordinates and let 


b 
r=Va?+b?, tang= 7 (B.58) 


then multiplication of a vector v by A = ; il corresponds, in the case 
b > 0, to a counterclockwise rotation through @ rad, which is then followed 
by a stretching or shrinking of the length of the vector by a factor of r; see 
Hirsch and Smale [22] for a more in-depth discussion. If b < 0, the rotation is 
clockwise, whereas if b > 0 the rotation will be counterclockwise. Our rotation 
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matrix is 


cos@ — | (B.59) 


Ag = ie cos @ 


Because we have a = rcos ¢,b = rsin¢, we can write 
a —b6]_ |r 0][cos®é —sing 
b af {|0 rj|{sind cosd |° 
This last equality gives us the interpretation of a rotation followed by a 


stretch. 
ea 


It is probably natural for the reader to question the usefulness of the in- 
terpretation of Example 5 in the case when our matrix is not initially of the 


form 

a —b 

bo a |? 
where the eigenvalues of the original matrix are a + 7b. For a general matrix 
with complex (nonreal) eigenvalues, we can use a similarity transformation 


to convert the original matrix to the above form. The details of this can be 
found in Appendix B.4.1. 


3. Projection. We can also write a matrix that will project any vector onto 
a given line. If we consider a vector and a line on which we wish to project, 
the projection is defined as the component of the vector in the direction of 
the line. In this situation, we can write a matrix in the form 


cos? ¢ cos¢@ sing 
A= B. 
cos¢ sing sin?7d |’ a0) 


where ¢ (measured counterclockwise from the origin) is the angle of the line 
through the origin that we will project onto. Let us again look at a simple 
example by considering the vector [1 2]? and projecting it onto the y-axis. 
The y-axis is 7/2 rad counterclockwise from the positive z-axis and thus ¢ = 
m/2 rad. Our matrix in this case becomes 


ae, eon 


and applying this matrix to our vector gives 


fo b= Lb]: (30 


This answer is what we expected given that the component in the direction 
of the y-axis is 2. The reader should again try a few additional examples so 
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FIGURE B.6: Vector [1 2]” projected onto the y-axis. 


as to be convinced that the above matrix projects any given vector passing 
through the origin onto a line passing through the origin with angle ¢. 


| Example 6 | 2) Consider 
1 0 
a=[} 4). 
For any x = [x y]’, we see that Ax = [x 0]", a projection onto the z-axis 


(= 0). - 


4. Reflection. Sometimes we wish to reflect a vector over a given line. We 
again consider a line through the origin that makes an angle @ with the z-axis, 
where ¢ is measured counterclockwise. The matrix that will do this reflection 


is 
2cos?¢—1 2cosd sing 
2cos¢@ sind 2sin?¢d—1 |’ 


(B.63) 


As an example, let us reflect the vector {1 1]” across the 7/6 rad line. Our 
linear transformation and vector multiply as 


| V¥3/2 H _ | v3/2+1/2 
~~ Te Bf AsO" (Al) Wis 1)78 
The angle that this vector makes with the positive x-axis is 


tang = Y8= DP _, g _ 159 0.2618 rad. 
(V3 + 1)/2 


The reader should again try a few additional examples so as to be convinced 
that the above matrix reflects any given vector passing through the origin 
across a line passing through the origin with angle @. 


1.366 
x B.64 
ree Ss 
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a ty y 
1 
et {VstD/2 


a ka \WT-D/ 
xX 


FIGURE B.7: Vector [1 1]” reflected across the line 7/6. 


Other Linear Transformations 

In dealing with differential equations, most of the linear transformations that 
we encounter will have a nice interpretation as a matrix. More generally, we 
consider the following: 


Definition B.3.1 

Let V and W be vector spaces. The function T : V + W is called a 
linear transformation of V into W if 

(1) Tut v) =T(u) +T(v) 

(2) T(cu) = cT(u) 

both hold true for all u, v in V and for any scalar c. 


We observe that matrices are clearly linear transformations by this defini- 
tion, with T(v) = Av. 


| Example 7 | Consider the differential operator, D = 4, from Section 3.1.1. 


We define C1{a,b] to be the set of all functions with continuous first deriva- 
tives on [a,b] and C°[a,b] to be the set of all continous functions on {a, b]. 
For any functions 2(t), y(t) in Ct[a,b] and any constant c, we see that (1) 
D(a+y) = Dx+ Dy, and (2) D(cxr) = cD(a). Thus, we say that D is a linear 


transformation from C1[a, b] into C°[a, bj. = 


DOS) Consider f : R + R defined by f(x) = cos(x). This is not a 


linear transformation because cos(# + y) # cosa + cosy for all x,y, which 
is required of a linear transformation. For example, take z = y = 5 to see 
linearity does not always hold. 


If we let v be a vector in V and w be a vector in W such that T(v) = w, 
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we say that w is the image of v under T. The set of all images of the vectors 
in V is called the range of T. In Section 5.3.1, we discussed the column space 
and nullspace of a matrix. Analogous concepts hold for all linear tranforma- 
tions. 


Definition B.3.2 

Let T: V > W be a linear transformation and consider T(v) = 0. The 
set of all vectors v in V that satisfy this equation is called the kernel of 
T, often denoted ker(T). The dimension of the kernel of T is called the 
nullity of JT, often denoted nullity(T). The dimension of the range of T 
is called the rank of T, often denoted by rank(T). 


In our discussion of vector spaces, the set of vectors that satisfied Av = 0 
lived in the nullspace of A. We also discussed the rank of a matrix and 
it is the same here. We finish with what hopefully appears to be a familiar 
theorem (cf. Theorem 5.3.2). 


THEOREM B.3.1 
Let T: V — W be a linear transformation from an n-dimensional vector 
space V into a vector space W. 


rank(T) + nullity(T) =n. 


| Example 9 | ~), Let’s consider the projection of a vector in R? to the z-axis (still 


in R?). Then (B.60) gives us the linear transformation 
1 0 
a=) 9] 
describing this projection. By inspection, we see that ker(A) consists of 


all vectors of the form | for any constant c. Because dim(R?) = 2 and 


nullity(A) = 1, we have that rank(T) = 2 — nullity(T) = 1. - 


Problems 


In Problems 1-9, consider the given vector x. Find the vectors that result 
from each of the following: 

(a) stretch by a factor of c (sketch the original vector and the resulting vector) 
(b) rotation by an angle of ¢ (sketch the original vector, the angle of rotation, 
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and the resulting vector) 

(c) projection onto the line that makes an angle ¢ with the z-axis (sketch the 
original vector, the line of projection, and the resulting vector) 

(d) reflection through the line that makes an angle ¢ with the x-axis (sketch 
the original vector, the line of reflection, and the resulting vector) 


1. x = [1 3]” for (a) stretch by c = 3, (b) rotation by ¢ = 7/2, 
projection onto the line at angle ¢ = 7/2, (d) reflection through the line 
at an angle ¢ = 7/2 

2.x =[-1 — 2]? for (a) stretch by c = —2, (b) rotation by ¢ = 7, (c) 
projection onto the line at angle ¢ = 7, (d) reflection through the line at 
an angle é=7 

3. x = [2 1]? for (a) stretch by c = —1, (b) rotation by ¢ = —7/4, (c) 
projection onto the line at angle ¢ = 0, (d) reflection through the line at 
an angle ¢ = 0 

4. x = [-2 3]? for (a) stretch by c = 3, (b) rotation by ¢ = 7/3, (c) 
projection onto the line at angle ¢ = 7/3, (d) reflection through the line 
at an angle ¢ = 7/3 

5. x = [1 — 3]? for (a) stretch by c = 4, (b) rotation by ¢ = 7/3, (c) 
projection onto the line at angle ¢ = 7/3, (d) reflection through the line 
at an angle ¢ = 7/3 

6. x = [-3 1]? for (a) stretch by c = 2, (b) rotation by ¢ = —7/2, (c) 
projection onto the line at angle ¢ = 7/3, (d) reflection through the line 
at an angle ¢ = 7/6 

7.x =[-1 —- 1]? for (a) stretch by c = 3, (b) rotation by ¢ = 7/3, (c) 
projection onto the line at angle ¢ = 7, (d) reflection through the line at 
an angle ¢=7 

8. x = [2 0]” for (a) stretch by c = 3, (b) rotation by ¢ = 7/4, (c) projection 
onto the line at angle ¢ = 7/3, (d) reflection through the line at an angle 
g=T7/6 

9. x = [3 2] for (a) stretch by c = 2, (b) rotation by ¢ = 7, (c) projection 
onto the line at angle ¢ = 7/2, (d) reflection through the line at an angle 
g=7/2 


2) 
Nee? 


10. Let A be a 2 x 2 reflection matrix. Show that A? = J. This shows that 
if y is a reflection of x, then applying the reflection matrix again gives us 
the original vector. 

11. Consider the reflection matrix given in Equation (B.63). Let m be the 
slope of the line of reflection. By setting m = tan @ and using basic trig 
identities, show that the reflection matrix can also be written 


(B.65) 
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12. Determine whether T : R? + R?, T(a,y) = (2,1) is a linear transforma- 
tion. 

13. Determine whether T : R? > R?, T(z, y,z) = (x+y,x—y, 2) is a linear 
transformation. 


14. Let P be the vector space of polynomial functions. Show that the definite 
integral, T: P > R, T(p) = J? p(w)da, is a linear transformation. 


Let T : V > W be a linear transformation and u, v be vectors in V. In 
Problems 15-17, show that given properties hold. 
15. 7T(0) =0 16.T(-—v) =-v_ 17. T(u-—v)=T(u) —-T(v) 


B.4 Coordinates and Change of Basis 


In this section, we examine how to represent a vector given a basis, and 
how changing from one basis to another affects this representation. It is best 
understood after Sections B.3 and 5.4. In terms of vectors in R”, we are used 


1 0 0 
to thinking of the standard basis, O;},;1),)0 . For example, if we 
0 0 1 
consider the vector 
3 
w= |-2], (B.66) 
5 


we probably interpret it as “3 units in the «x-direction, —2 units in the y- 
direction, and 5 units in the z-direction.” This is correct if we are using the 
standard basis (often denoted {e;,e2,e3}) and we could write 


3 1 0 0 
-2| =3]0] —2]1] +5] 0] =3e, — 2e2 + 5e3. (B.67) 
5 0 0 i 


Writing w as we did in (B.66) is called the coordinate vector of w rela- 
tive to the standard basis. The coordinates of x relative to the basis 
are exactly the coefficients that we used to write it as a linear combination of 
the standard basis vectors. We also need to specify that we have an ordered 
basis, which just means that we need to keep the same order of the basis 
vectors when we refer to the basis. The representation of w would probably 
change if we changed the basis. 

For example, if our basis B is 


of, fil, al, (B.68) 
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then the vector w is written 


5 1 1 1 
[w]>=|-7] =5]/0] —7]1] 45/1). (B.69) 
5 0 0 i 


How did we find the coordinate vector of w relative to a given basis? We 
want to find a linear combination of the ordered basis B that gives us the 
coordinates of w in the standard basis: 


1 1 1 3 
cy |O} teo} 1) 4+e3]/1} =] -2]. (B.70) 
0 0 1 5 


We could have put this as a problem from Appendix B.2, because we simply 
need to solve a system of three equations in three unknowns. In matrix 
notation we have 


111 Cy 3 
0111 lel =|-2], (B.71) 
0 0 1 C3 5 
~N 
P [w]p [w] 5 


and we can easily solve this to find the coefficients, which are the coordinates 
of w relative to B. Here, we let P denote the transition matrix from B 
to S. The formula 

Plw]; = [wl], 


is the change of basis from B to S. If we wanted the change of basis from S 
to B, we could use the following theorem: 


THEOREM B.4.1 


Let P be the transition matrix from S to B. Then P is invertible and 


[w]> = Pel Walee 


is the transition matrix from B to S. 


In the above discussion, we could have used any two ordered bases in place 
of Band S. 


It is often of interest to find the matrix that will take an ordered basis B 
to another ordered basis B’, instead of being concerned only with how the 
coordinate representation of one vector changes. 
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THEOREM B.4.2 
Let {v1,v2,--:,Vn} be the ordered basis B, and {uj, us,--- ,u,} be 
the ordered basis B’ for a given vector space V. Then the bases can be 
related by 
Vy = C101 + chy U2 +--+ Un (B.72) 
V2 = City + ChoUg +-++CoUp (B.73) 
t=! (B.74) 
Vn = Ci, U1 + Ch, U2 +--+ C3Un- (B.75) 
Moreover, applying Gauss-Jordan elimination to the system 
Cit Wiig, 8a Vil U1 U12 +" Ulin 
U2 22 C27 U21 U22 *"* U2n 
[B|el=) 0 . ; a (B.76) 
Uni Un2 coo Cay Uni Un2 sts Unn 
gives us 
[B| B]— [1| P™"), (B.77) 
where P~! is the transition matrix from B to B’. 


|Example 1:| Consider the following two bases in R?: 


9] [4 5 1] [fo] fo 
Be<|7.)<i),) 2 and B’=2]{o],]1],]0 
0 3 -1 o} Jo} fa 


The transition matrix from B to B’ is found by writing the augmented matrix 


2 -4 5 1 0 0 
1-1 2 0 1 0 
0 3 -1}]0 0 1 


and row-reducing it via Gauss-Jordan elimination to the form 


1 0 0 ;-5 11 —8 
0 1 0 1 -2 1 
0 0 1 3-6 2 


The transition matrix from B to B’ is thus given by 


—-5 ll -3 
Pt=/]1 -2 1 
3-6 2 
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B.4.1 Similarity Transformations 


Many times it is convenient to use the standard basis. But when we are 
trying to understand the qualitative behavior of solutions of differential equa- 
tions near an equilibrium point (in Sections 6.1 and 6.2), it is often useful to 
convert to eigencoordinates where the eigenvectors will be a basis for the 
space. This is because the resulting matrix will often be diagonal (and at least 
always in Jordan form, where the matrix is block diagonal); see Section 
5.6. 

In (B.3), we gave the interpretation of matrix-matrix multiplication being 
equivalent to multiplying the columns of the right matrix with the left matrix 
to obtain the columns of the result. That is, for AB = C, we let bj and c¢; 
denote the columns of B and C, respectively, and we write 


Ab; = Cj. 


Using this interpretation we can write our eigenvectors as columns of a matrix 
V. Then our system becomes 


AV =VA, (B.78) 
where 
Ay O 0 Vit V12 0 t+) Vin 
0 rg 0 Vai U22,—O Un 
A= and V=|. |, |. (B79) 
: 0 . : 0 . . . F . 
0 0 ove Xn Uni Un2 sts) Unn 


(Note that the right-hand side is not AV.) If we assume that our matrix A 
has n linearly independent eigenvectors, then our matrix V is invertible and 
we can write 


A=V7'AV. (B.80) 


Note that A is a diagonal matrix. Thus this equation says that left multiply- 
ing our original matrix A with V~! and right multiplying it with V yields a 
diagonal matrix. This process is called a diagonal similarity transforma- 
tion. Our original matrix really did not matter other than we needed it to 
have n linearly independent eigenvectors, which may or may not happen for 
a given matrix. 

In terms of coordinates and change of bases, we are given a matrix A relative 
to the standard basis, S, and we want to find the matrix relative to the basis 
of the eigenvectors, B’. The transition matrix from B’ to S is exactly our 
matrix V that has the eigenvectors as the columns. The transition matrix 
from S to B’ is thus V~!. We combine this together to obtain the matrix 
relative to the basis of eigenvectors as 


VAY. 
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| Example 2:| Diagonalize the matrix 


by using a diagonal similarity transformation. 


Solution 

We need to find the two eigenvectors of the matrix first. If they are linearly 
independent, then we will be able to proceed. We could do this by hand or 
with the computer to find the eigenvalue-eigenvector pairs as 


tL el 


We can thus write the matrix of linearly independent eigenvectors and calcu- 
late its inverse: 
2 | = =3 
ie 3/, V =| 8 ; 
1 3 4 


The original matrix A can be diagonalized as 


NIRBIF 


i cege Pe W 
Vv av=[7 ae 
a 


If we have complex eigenvalues, we usually do not diagonalize the matrix 
simply because this would introduce complex variables into a problem that 
originally had real numbers. In Section B.3, we considered the system 


d. 

ai = ax — by 

d 

ih = br + ay, (B.81) 


where a,b are real and b £ 0. We saw that the eigenvalues are a + ib and 
we interpreted the action of the matrix as a rotation through an 
angle 6 followed by a stretch by a factor r, where r = Va? + b? and 
tan@ = b/a are the standard polar coordinates. Thus we can think of 
(B.81) as being the desired form of a system whose coefficient matrix has 
complex eigenvalues. Analogous to the case of real eigenvalues, we can use a 
similarity transformation to convert the matrix to this form. 


| Example 3:| Consider 
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The eigenvalues can be easily calculated as 1 + 22,1 — 2i with eigenvectors 
(1 —1+i)7,(1 —1-i)7, respectively. We previously used the eigenvectors 
as the columns of our matrix V. Our eigenvectors are now complex but they 


still give us the insight that we need. We write one of the eigenvectors in the 
form v, + iv2. If we take the first one, this would give 


[ass [LA] [i] 
We then use v; and v2 as the respective columns of our matrix V: 
voav= [1 a ke 2 [2 1 
-1 1 —-4 -1]]-1 1 
=|; {2 Alle | 
1 1)/-4 -1}]]/-1 1 


= ie il (B.82) 


If we had chosen the second eigenvector, we would have had E fal .In 


either case we see the eigenvalues in the matrix as 1 + 2i. 


In general, two n x n matrices A and B are similar if there exists an 
invertible matrix P such that 


B=P!AP. 


Based on the previous discussion, we can state the following theorem. 


THEOREM B.4.3 


Similar matrices have the same eigenvalues. 


Problems 


In Problems 1—4, consider the bases B and B’ and vector w. 
(a) Find the transition matrix from B’ to B. 

(b) Find the transition matrix from B to B’. 

(c) Compute the coordinate matrix [w],,, for the given w. 
(d) Use part (c) to compute [w],,. 
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1. In R?, w= be for bases 
_ ft] fo Te) (Ss 
e= {a} = [) (2 

2. In R?, w= i for bases 


—5 
3. In R?, w= | 8 | for bases 
5 
—3 —3 1 —6 —2 
2210 | S|. 16s, BS lobly ||, 
—3 —1 1 0 4 
—4 
4. InR?, w= | 7 | for bases 
—4 


723 


9 a 1 3 1 | 
B=2|1|, }-1|, Jal $,B’= 1}, }a1, |os. 
2 1 2 =f = 3 


In Problems 5-10, if possible, find a matrix P that diagonalizes the matrix 


A and then determine P~!AP. If it is not possible, explain why. 


2 0 1 0 2 -3 
[i 3] 2 ee 

3 0 0 20 -2 00 -2 
8./0 2 0 9/0 3 0 Oo) 2 4 

0 1 2 00 5 10 3 
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Appendix B Computer Lab: MATLAB 


MATLAB Example 1: Enter the code below to use some of the basic 

linear algebra commands for manipulating matrices and vectors. 

>> clear all 

>> A=[1 3 5;1 7 9;1 2 3] %creates the matrix A 

Ss anl\ 

>> 2*A %same result as A+A 

>> Ax*A 

>> A2 %same result as A*xA 

>> B=inv(A) %calculates the inverse of A 

>> B*A %verifies that B is the inverse of A 

>> A’ f%transpose of A 

>> trace(A) 

>> det (A) 

>> x=[8 17 30] %a row vector 

>> x=[8; 17; 30] %a column vector 

>> Ax*x /;matrix-vector multiplication, note the 
Zdimensions must match 

>> x’*A {vector-matrix multiplication, note the 
7dimensions must match 

>> b=[0; 1; 3] %a column vector 

>> y=A\b %solution of the system Ay=b 

>> A=[A;2 4 6; 8 10 12] appends two rows as the 4th 
jand 5th rows of A 

>> AC:,4)=[1;2;3;4;5] Zappends one column as the 4th 
%column of A 

> AC(:,3) %selects the 3rd column of A 

>> A(4,:) selects the 4th row of A 

>> A(2:4,3:4) selects the submatrix of A consisting of 

ithe elements in rows 2 through 4 and columns 3 through 4 


MATLAB Example 2: Enter the code that uses elementary row operations 
for row reduction, followed by the built-in solver for Ax = b. Consider the 
augmented matrix 


Oeolorten seo 
Daal eesiens Oi (B.83) 
438 


>> clear all 
>> A=(2,1,4,1;2,1,-1,0;4,3,2,-1] %creates augmented matrix 


= 


= 


= 


= 


= 


= 


= 


= 


= 


LE 
= 
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A(2,:)=A(2,:)-A(1,:)%row 1 of A subtracted from row 2 
fand inserted as the new row 2; A is overwritten 
A(3,:)=A(3,:)-2*A(1,:) %2 times row 1 of A subtracted 
%from row 3 and inserted as the new row 3 
A=A([1,3,2],:) %swaps 2nd and 3rd rows of A 
A(1,:)=A(1,:)/2 %multiplies row 1 by 1/2 
A(3,:)=-A(3,:)/5 /;multiplies row 3 by -1/5 

INGL, SVaNGL, ANA, s/2 Yaron 2 oe A, ule toy 1/2, relaeia 
%subtracted from row 1 and inserted as new row 1 
A(2,:)=A(2,:)+6*A(3,:) row 3 of A, mult by -6, then 
Zsubtracted from row 2 and inserted as the new row 2 
A(1,:)=A(1,:)-5*A(3,:) %row 3 of A, mult by 5, then 
%subtracted from row 1 and inserted as the new row 1 
#We are now in reduced-row echelon form; alternatively, 
B=[2,1,4,1;2,1,-1,0;4,3,2,-1] %re-creates original matrix 
rref (B) 


MATLAB Example 3: Enter the code that finds the eigenvalues and 


eigenvectors (via the built-in commands) and then uses them to diagonalize 
the matrix A. 


LE 
= 
LE 
= 


= 


clear all 

A=[-1, 4; 3, 3] 

[v,d]=eig(A) eigenvalues AND eigenvectors of A 

v %shows the matrix v, which has the eigenvectors as its 
% columns; we should verify that we have lin ind columns 
inv(v)*A*v {diagonalizes A 


MATLAB Exercises 

Turn in both the commands that you enter for the exercises below as well as 
the output/figures. These should all be in one document. Please highlight or 
clearly indicate all requested answers. Some of the questions will require you 
to modify the above MATLAB code to answer them. 


il, 


Enter the commands given in MATLAB Example 1 and submit both your 
input and output. 


. Enter the commands given in MATLAB Example 2 and submit both your 


input and output. 
Enter the commands given in MATLAB Example 3 and submit both your 
input and output. 


In Exercises 4-17, consider: A= | a | , = Ee 7 | ; 


eel j= 

3 <4 ly ee ese 
G=| 1 Cl.cjaia 0 8 |,CGp=\|30 2 4 
ait ee ee ede 


19. 


20. 


Palle 


22 


23. 


24. 


. Compute (a) Ci + C2; (b) 

. Compute (a) 2C; +3C2; (b) 2C 
. Compute (a) 4C2 — 2Cy; (b) Tr(C2) 
. Compute (a) T. 

. Compute (a) C 

. Compute (a) C 

. Compute (a) te (b) C2Cy 
. Compute (a) C 

. Compute (a) C 

. Compute (a) 

. Compute (a) 

. Compute (a) 

. Compute (a) 

. Compute (a) Cy~'; (b) C27? 

. Use elementary row operations to find the reduced-row echelon form of 
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C, — Cz 


Gy (b) Tr(3C1) 
oe 
+,7 - (b) CA 


soe BC’ 
(is) Leer, 
ae (b) det(B) 
det(B2); (b) devices) 
Hee(@s@,); (hy dea@, deo) 
Core Be 


t 
iE 
det 


2 6 -2 -1 
0 -3 1 0 
0 0 D 2 
Use elementary row operations to find the reduced-row echelon form of 
1 3 -6 0 
0 -2 1 1 
Use elementary row operations to find the reduced-row echelon form of 
2 3 -3 0 
0 1 -1 2 
3 1 0 -2 
Use elementary row operations to find the reduced-row echelon form of 
—2 4 -3 0O 
1 if =i & 
5 1 0 —5 
Use elementary row operations to find the reduced-row echelon form of 
=z dA @ 2 
1 il 8 2 
1 -1 1 0 
Use elementary row operations to find the reduced-row echelon form of 
2 6 0 4 
-1 1 4 2 
Ll =i =4 =2 


Use a similarity transformation to diagonalize |—1 6 5 
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2 -2 1 
25. Use a similarity transformation to diagonalize |—-3 3 1 
3s =2 C 
1 -2 -1 
26. Use a similarity transformation to diagonalize |} —-1 0 =i 
il 1 2 
—2 2 0 
27. Use a similarity transformation to diagonalize | 4 0 0O 
=i) § 
eee 
=2 =D 
25, 
28. Use a similarity transformation to diagonalize aa Tee 
2 =e ali 
3 3 
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Maple Example 1: Enter the code below to use some of the basic linear 
algebra commands for manipulating matrices and vectors. 


restart 

with( LinearAlgebra) #loads the package for linear algebra 
A := Matria(|[a, 6], [c, d]]) 

B := MatrizInverse(A) #inverse of A 

A7' #also the inverse of A 
MatrizMatrizMultiply(A, B) #:matrix multiplication 
A.B #also matrix multiplication 

simplify(A.B) 

side = 3,0= le=4d = iL, A) 

Cl = Monreal, 3,5), |, % Oh, [il 2,24) 

Cac 

2:-C 

Transpose(C) 

Trace(C) 

Determinant(C) 

x := Vector([8,17,30]) #a column vector 

< 8,17,30 > #also a column vector 

xT := Transpose(x) #its transpose gives row vector 
pee #also a tranpose operation 

Cx 
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sp IC! 

b := Vector((0, 1, 3]) 

y := LinearSolve(C, b) #solution of Cy=b 

C 

Column(C, 3) #selects 3rd column of C 

Row(C, 2) #selects 2nd row of C 

Ci =< C,,< 2%, 4,6 See < 8,10,12 >*”T > 4 appends two rows as the 4th 
and 5th rows of C 

C2 :=< Cl| < 1,2,3,4,5 >> #appends a column as the 5th column of A 

DeleteColumn(C2, 1..2) #deletes columns 1 through 2 in C 

DeleteRow(C2, 1..3) #deletes rows 1 through 3 in C 

SubMatria(C2, 2..4,3..4) #selects the submatrix of A consisting of the 
elements in rows 2 through 4 and columns 8 through 4 


Maple Example 2: Enter the code that uses elementary row operations for 
row reduction, followed by the built-in solver for Ax = b. Consider the 
augmented matrix 


2D il Al 1 
Mae Weil cnien (B.84) 
4 3 2B —1 
restart 
with( Student|LinearAlgebra]) : #loads the package that allows ero 
A:= Matriz(([2,1, 4, 1], [2, 1, -1, 0], [4, 3, 2, -1]]) 
Al := AddRow(A, 2,1,—-1) #row 1 of A, multiplied by —1, 
then added to row 2 and inserted as the new row 2 
A2:= AddRow(A1,3,1,—2) #row 1 of A1, multiplied by —2, 
then added to row 3 and inserted as the new row 3 
A3 := SwapRow(A2, 2,3) #swaps the 2nd and 8rd rows of A2 
Af := MultiplyRow(A38, 1,1/2) #multiplies row 1 by 1/2 


1 
Ad := MultiplyRow (44, 3, a) 


A6 := AddRow { A5,1, 2, -5 
A7:= AddRow(A6, 2, 3,6) 

A8 := AddRow(A7, 1,3, —5) 
A9 := GaussianElimination(A) 
BackwardSubstitute(A 9) 
ReducedRowEchelonForm(A) 


Maple Example 3: Enter the code that finds the eigenvalues and eigen- 
vectors (via the built-in commands) and then uses them to diagonalize the 
matrix A. 
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restart 

Palen at : 

A := Matria(|[-1, 4], [3, 3]]) 
[do = ene el ) #eigenvalues AND eigenvectors of A 
Evl := Column(Ev[2], 1) #first eigenvector 

Ev2 := Column( Ev[2], 2) #second eigenvector 

V := Ev[2| #matrix with eigenvectors as columns 

V_|.AV #diagonalizes A 


Maple Exercises 

Turn in both the commands that you enter for the exercises below as well as 
the output/figures. These should all be in one document. Please highlight or 
clearly indicate all requested answers. Some of the questions will require you 
to modify the above Maple code to answer them. 


1. Enter the commands given in Maple Example 1 and submit both your 
input and output. 


2. Enter the commands given in Maple Example 2 and submit both your 
input and output. 


3. Enter the commands given in Maple Example 3 and submit both your 
input and output. 


In Exercises 4-17, consider: A = | i ‘ ie [> - | : 


Cubs 08) Ch 
ooh See (5) 26 
) 4€3 — 21; (b) Ir(Ca) 
) Tr(B); (b) Tr(3C1) 
es (bea 

a) C+C,"; (b) CA 
) C1C2; (b) C2Cy 

CleR (ey) Eee 

CsC; (by C765 

) CBA: (b) det(B) 

) det(B?); (b) det(C1C2) 

) det(C2C1); (b) det(C2)det(C1) 


730 


16. 
ie 
18. 


il), 


20. 


Pale 


Da 


23. 


24. 


25. 


26. 


Die 


28. 
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Compute (a) det(C1"); (b) B71 
Compute (a) C,~'; (b) C27! 
Use elementary row operations to find the reduced-row echelon form of 
2 6 -2 -1 
O Say il 0 
0 0 2 2 
Use elementary row operations to find the reduced-row echelon form of 
1 3 -6 0 
0 -2 1 1 
Use elementary row operations to find the reduced-row echelon form of 
23 -3 0 
1 =|i 28 
3 1 0 —-2 
Use elementary row operations to find the reduced-row echelon form of 
—2 4 -3 0O 
1 1 -1 #5 
Oe 
Use elementary row operations to find the reduced-row echelon form of 
—2 4 0 2 
1 il 8 2 
1 -1 1 0 
Use elementary row operations to find the reduced-row echelon form of 
2 6 0 4 
ee 4 2 
sl 42 


Use a similarity transformation to diagonalize 


Use a similarity transformation to diagonalize 


Use a similarity transformation to diagonalize 


1 —-2 -1 
Use a similarity transformation to diagonalize - =I 
Use a similarity transformation to diagonalize | 


| |! | 
oer] loo | win oS 
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Appendix B Computer Lab: Mathematica 


Mathematica Example 1: Enter the code below to use some of the basic 
linear algebra commands for manipulating matrices and vectors. 


Quit] 
Me (eso) deg Gg) aoa) 
A//MatrixForm (*displays matrix in a nicer visual form*) 
MatrixForm[A] (*alternate syntax*) 
(A+A) //MatrixForm 
(*parentheses in above line allow calculations to be done 
later*) 
(2A)//MatrixForm (*same result as A+A*) 
(A.A)//MatrixForm 
(MatrixPower[A,2])//MatrixForm (*same result as A.A*) 
(B=Inverse[A])//MatrixForm (*calculates the inverse of A*) 
(B.A)//MatrixForm (*verifies that B is the inverse of A*) 
(Transpose[A])//MatrixForm (*transpose of A*) 
Tr [A] 
Det [A] 
(X = {{8, 17, 30}})//MatrixForm (*a row vector*) 
(X = {{8}, {17}, {30}})//MatrixForm (*column vector*) 
(A.X)//MatrixForm (*matrix-vector multiplication, note the*) 
(*dimensions must match*) 
(Transpose[X].A)//MatrixForm (*vector-matrix multiplication, *) 
(*note the dimensions must match*) 
(b={{O}, {1}, {3}})//MatrixForm (*a column vector*) 
y=LinearSolve[A,b] (*solution of Ay=b*) 
(A=Join[A, {{2,4,6}},{{8,10,12}}])//MatrixForm 
(*appends two rows as the 4th and 5th rows of A*) 
(A=Join[A, {{1},{2},{3}, {4}, {5}},2])//MatrixForm 
(*appends column by placing one additional entry at end of 
each row*) 
(Take[A,A11,{3,3}])//MatrixForm (*selects the 3rd column of A*) 
(Take[A,{4,4}])//MatrixForm (*selects the 4th row of A*) 
(Take [A,{2,4},{3,4}])//MatrixForm 
(*submatrix of A consisting of the elements in rows 2*) 
(*through 4 and columns 3 through 4*) 


Mathematica Example 2: Enter the code that uses elementary row opera- 
tions for row reduction, followed by the built-in solver for Ax = b. Consider 
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the augmented matrix 


oa 
7) ie =a} 0 | (B.85) 
4 3 


Quit[] 
(A={{2,1,4,1},{2,1,-1,0},{4,3,2,-1}})//MatrixForm (*the 
augmented matrix*) 
AC(2]] -=a((1]] 
(*row 1 of A, subtracted from row 2 and *) 
(*inserted as the new row 2*) 
A//MatrixForm (*visually nicer form*) 
AC(3]] -=2 A[(1]] 
(*row 1 of A, mult by 2, then subtracted from row 3 and*) 
(*inserted as the new row 3*) 
A//MatrixForm 
M2, SHISATINS, 21 


(*swaps 2nd and 3rd rows of A*) 
1 
ACT(1]] = 5 *AL [11] 


(*multiplies row 1 of A by 1/2*) 
A//MatrixForm 


1 
AC(3]] =~, *AL [31] 
(*multiplies row 3 of A by -1/5*) 


A iMate a orm 
AC(1]] -= 5 *ALL2]] 


(*row 2 of A, mult by 1/2, then subtracted from row 1 and*) 
(*inserted as the new row 1*) 
A[([2]] -=-6*A[([3]] 
(*row 3 of A, mult by -6, then subtracted from row 2 and*) 
(*inserted as the new row 2*) 
A//MatrixForm 
AC(1]] -=5*A[(3]] 
(*row 3 of A, mult by 5, then subtracted from row 1 and*) 
(*inserted as the new row 1*) 
A//MatrixForm 
(*We are now in reduced-row echelon form; *) 
(*alternatively, we could have used: *) 
(B={{2,1,4,1},{2,1,-1,0},{4,3,2,-1}})//MatrixForm (*the 
augmented matrix*) 
(RowReduce[B])//MatrixForm 
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Mathematica Example 3: Enter the code that finds the eigenvalues and 
eigenvectors (via the built-in commands) and then uses them to diagonalize 
the matrix A. 


Quit[] 

= {{-1,4},{3,3}})//MatrixForm 
eqi=Eigensystem[A] (*eigenvalues and eigenvectors of A*) 
(eq2a=eqi[[2]] [[1]])//MatrixForm (*first eigenvector*) 
(eq2b=eq1[[2]][[2]])//MatrixForm (*second eigenvector*) 
(V = Transpose[eq1[[2]]])//MatrixForm 

(*eigenvectors are the columns of V*) 
(eq3 = Inverse[V].A.V)//MatrixForm (*diagonalizes A*) 


Mathematica Exercises 

Turn in both the commands that you enter for the exercises below as well as 
the output/figures. These should all be in one document. Please highlight or 
clearly indicate all requested answers. Some of the questions will require you 
to modify the above Mathematica code to answer them. 


1. Enter the commands given in Mathematica Example 1 and submit both 
your input and output. 


2. Enter the commands given in Mathematica Example 2 and submit both 
your input and output. 


3. Enter the commands given in Mathematica Example 3 and submit both 
your input and output. 


In Exercises 4-17, consider: A= | ; | = i : | 


= oe: 
fe ee eee) (hee soe 
C=H|2 Ol.Grai1 @ 8 |. Geilo 2 7 
a a Boo il ie 


4 (a) Cy 4 C2; (b)Ci—C, 
5 (a) 2C1 +3C2; (b) 2C 
6. Compute (a) 4C2 — 2C 4; (b) Tr(C2) 
7. Compute (a) T ue ); (b) Tr(3C1) 
8. Compute (a) C7; (b) A? 
9 (a) 
(a) 
(a) C 
(a) C 


. Compute (a) Cy 
Compute (a) 2C 
4C 


. Compute (a ors ; (b) CA 
ae (b) C2Cy 
11. Compute (a me eB: 


12. Compute (a ; (b) CPC, 


C 
10. Compute (a) C 
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13. 
14. 
15. 
16. 
17. 
18. 


19. 


20. 


ale 


DDE 


23. 


24. 


25. 


26. 


Pie 
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CBA; (b) det(B) 
det(B?); (b) det(C1C2) 
det(C2C;); (b) det (C2 )det(C;) 
Compute (a) det(C1"); (b) Bu! 
Compute (a) GC; *2 (b) Ca 
Use elementary row operations to find the reduced-row echelon form of 
2 6 -2 -1 
0 -3 1 0 
© 2 2 
Use elementary row operations to find the reduced-row echelon form of 
1 3 -6 0 
0 -2 1 1 
Use elementary row operations to find the reduced-row echelon form of 
23 -3 0 
Od =i 2 
3 1 0 -2 
Use elementary row operations to find the reduced-row echelon form of 
—2 4 -3 0 
i ah a 
5 1 0 —5 
Use elementary row operations to find the reduced-row echelon form of 
—2 4 0 2 
1 1 3 2 
1 -1 1 0 
Use elementary row operations to find the reduced-row echelon form of 
2 6 0 4 
-1 1 4 2 


Compute (a 


( 

Compute (a 

Compute (a 
( 


le es Se 


Use a similarity transformation to diagonalize 


1 -1 -4 -2 

4 -—8 —10 
Use a similarity transformation to diagonalize |—1 6 5 

lL =8 = 

2 -2 1 
Use a similarity transformation to diagonalize |-3 3 1 

3 =2 0 

il 2 -1 
Use a similarity transformation to diagonalize | —1 -1 

1 2 


Bi 


Appendix B Computer Labs 


3, 
Use a similarity transformation to diagonalize z 
3 


| |! 
[Lele 


w] | oo 
a 
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It always seems to start from some lecture notes. ..it has been 
one interesting and crazy path! 


Thanks (again) for listening.... 


Answers to Odd Problems 


Section 1.1 


1. (i) 2nd order, (ii) linear, (iii) 
N/A 


3. (i) 2nd order, (ii) linear, (iii) 
N/A 


5. (i) 3rd order, (ii) linear, (iii) IVP 


7. (i) 1st order, (ii) nonlinear, (iii) 
IVP 


9. (i) 2nd order, (ii) nonlinear, (iii) 
N/A 


11. (i) 2nd order, (ii) nonlinear, (iii) 
BVP 


13. y/ (2) = 6a? > 2(6z7) = 322°), 


which is true for all x. 


15. y/(z) =0> 0 = 23(2—2)? = 0, 
which is true for all x. 


which is true for all x. 


19. y/(x) = 22 — x? and y"(xz) = 
2+a7%. Substitution shows its equa- 
tion holds for all « 40 


21. Note the solution does not ex- 


ist for c = 3. y'(@) = GaP ee 


2 
way = (=5) which is true when 


x #3. 


23. y=e", y =e, y=er=> 

— 3y' + 2y = e” — 3e” + 2c” = 0; 
y= er” y! = 26?" | y" = 4e2% => 
y” —3y'+2y = 4e?* —6e?* +2e?” = 0. 


25. (b)e *, {c) ze-**, and {e) 
2e—3* + re” are all solutions; (a) e” 
and (d) 4e%* are not solutions. 


27. (b) e3”, (c) e*”, and (e) e?* + 
2e4” are all solutions; (a) e?” and 
(d) e®” are not solutions. 


29. (a) = rey" (2) = re" S 
(r2e"") + 3(re "4 Q(e™™ =e" (r2 + 
3r +2) =0 > r = —2,-1, which is 


true for all x. 

31. y'(a) = rxe™ +e", 

y” (x) = r?xe"™® +2re™. Substituting 
and equating coefficients gives r= 
—3, which is true for all x. 


Section 1.2 


1. y(~) =sine+C 


3. a(t) =+V2t—-#?4+C 
5. g(x) = Cesc’ a 
7 y= way: where C = te 


9. y = log,) |—107 + C| 


2 
1/29x7—-1 


1l. y = +e and is even 
since we have only an x? term. 


2+2sin3 


13. smy+1= “237 
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15. y(x) = tan (3 — arctan(2?)) 
Cd e7t 
17. ioe = at 
19. y(x) sole © dt 
21. (a) y(x) = arctan (1 — +) 
23. y(x) = C(a + le 
25. Substitute u = 2y+.. Solution 


is 2y—2In|2+2+2y|+4+21n2=0 


27. Substitute u = 4¢%+2y—1. Solu- 
tion is x = —2 (In (\/4e + 2y—1+ 2)) 
— (44 + 2y—-—1 


29. It represents the long-term pop- 
ulation that the system can sustain. 


Section 1.3 


1. y=e*(F+C) 


3. y= e722 (=3= a 32a +4 c) 


) 


7. Must consider both x < 0, 7 > 
2 
0. Each gives y(x) = % + ©. 


5. y=er (- 


9. y=(1+27)(x — arctanz + C) 


11. y=e* ($(cosz + sinz) + C) 
13. y = 4e"(x 4+ 1) 

15. y=sinz —cosz 

17. y= sing + got 

19. r=y?+Cy 

21. x(y) = 2sin? y+ Csiny 


Section 1.4 


Answers to Odd Problems 


1. (a) v(4) = 12 
locity=64 ft/s; (c 


8 ft/s; (b) Ave ve- 
) 256 ft tall 
( 


3. vo = 3g =(3 s)(32 ft /s?)=96 ft/s 
5. 1.82 sec, 17.1 m, 2.04 sec, 20.4 
m 

7. v(t) = 60 (445) 

9. 40 min 

11. 64.5°F 

13. 10 min 

15. s(t) = 400 — 338e(-3t/50) _, 


conc= s(t)/25 —t 
17. 24 min 


19. 200 days 


21. (cta)y= 2a 

23. About 8am. 

Section 1.5 

1. Equation is not exact. 
3. x?y— 52 =C 

5. ry +y=C 

7. 84+23lny—y?+C 


9. x7y + 2y? +2 =2. Only the top 
curve in this implicit solution passes 
through the IC. 


Graph for 1.579. 


Answers to Odd Problems 


11. 2? — 3x3y? + y* = -1. Only 
the top curve in this implicit solu- 
tion passes through the IC. 


Graph for 1.5411. 


13. —re~¥ — yy? = —e-3 -9 
15. A=-—2; solution is 4 —£=C 


17. N(z,y) = x*y + o(y) 


Section 1.6 
Lys oe 


3. 527+ ay+In(y) =C 


5. y = —2xsin(x) + 2x? cos(x) + Cx 


7. ye? 2 =C 

» Y 3 > 
= 1 

11. y= syiycer 


13. In|y| = 42 —2?+C 
15. y? = —22 + C2? 
17..4/y = 27 In |2| + Cz? 
19, y = (—32? + C|z|5)1/8 
21, NG= ost 
23. y(z) = Cz? — x 
25. y=4ta//Inz+C 


27. y(x) = Ca" 


29. y= C(y? — 2”) 


31. arctan (4) $ In (1 (4)”) _ 


=i. 
33. + = 
V u(y—22) 

37. Substitution gives 

dy _ rcostdt+sintdr : : = 
dx ~~ _rsint dt+cos t dr and simplifica, 
tion gives 

dr __ —N cost+M sint 

dt Nsint+M cost . 


dt 


and solves to \/a? + y? 


exp [4 — In(cos(tan~! (4))) + C] 


39. “ =r(sec?t+tant) separates 


Al. Lines are parallel, so there is no 
point of intersection. 


43. In|x + 4| = —5In|1- 44 | 
A(x + 4) 


45. tan! (33) = 5ln|z—3|+C 


Chapter 1 Review 


1. False. An IC is needed for an IVP. 


3. False. We do not need to solve for 
y(x). 


5. False. Solutions need only be de- 
fined for x in the interval (a —h, xo + 


7. True. This form can always be 
separated. 


9. y'(z) = Ce® — 2a -2 = 2? 
y(x) = 2? + (Ce® — x? — 2x — 2) 
y'(x) for all x 


aa 


(y—3)? = (aby) =o 


13. y= +VCel/* + 2 


Graph for Chapter 1 Review#15. 


17 


19. 


21. 


23. 


25. 


27. 


29. 


31. 


33. 


35. 


. y= In| 


—In|2|+C 
ele 


cot (5 In (4)) =Inz+C 


arcsin (4) =Inxz+C 


ylna+4y*=C 
S+r+5=C 

p(x) = a8, 54 —y=C 
y? = 32 + Cx 

y = 72" [5e2"" (22? — 1) + C] 


The soup should be ready 34 


minutes before closing. 


37. The tank will fill in 15 minutes; 
y(15) = 12.43 lbs of salt. 

39. y= 2? 

Section 2.1 

1. b 

3. a 

5. b 


Answers to Odd Problems 


9. y' =cosy, 


see figure 


Bf Sy SS FQ OOS 
a i a i 


Graph for 2.149. 


11. y/ =siny, see figure 


ee ee ee 


Graph for 2.1411. 


13. y’ = cos, see figure 


SS See 
Sy Se 
Sa ee 


fo OS 
Ao eS 
ieee 


NN AY NN 
NN eS 
NRE SS 
KR SS ARN 


mS acme cae 
SOS 
NN a ZX 


fo FSS 
Pe ie 
ee 


Graph for 2.1413. 


15. y’ =sinz, see figure 


Graph for 2.1415. 


17. y' =a+y, see figure 


Answers to Odd Problems 


/ ff] 

/ Ie 

7 

ei obs ai 

a) 

/ ft 

// 11] 

aaa 2 3 7 

pa fff 

qw— 7 f 1 

Graph for 2.14/17. 

, see figure 


a 


NARS RAS 


\ANNAAAYY \ 


21. y' = ==, see figure 


25. y' y(x + 2), see figure 
| | 


a 


l 
| 
| 
I 
| 
| 
/ 
\ 
\ 


ee 
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Graph for 2.14/25. 


Section 2.2 


1. Yes, the Theorem guarantees ex- 
istence or uniqueness of a solution at 
(0,0). 


3. The theorem does not guarantee 
that a solution exists or is unique on 
some interval. 


5. Theorem does not guarantee ex- 
istence or uniqueness of a solution at 
(1,0). 


7. (i) Solutions exist for all (x, y); 
(ii) solutions are unique everywhere 
except possibly when y = —2. 


9. (i) Solutions exist for all (x,y); 
(ii) solutions are unique everywhere 
except possibly when y = x. 


11. (i) Solutions exist everywhere 
except possibly when y = 0; (ii) so- 
lutions are unique everywhere except 
possibly when y = 0. 


13. (i) Solutions exist everywhere 
except possibly when y = —2; (ii) 
solutions are unique everywhere ex- 
cept possibly when y = —a. 


15. Solutions will exist everywhere 
and will be unique everywhere ex- 
cept possibly along y = 2. Separa- 
tion of variables > y = 2 + (2x)5/? 
passes through (0,2). Since y = 2 
also passes through (0,2), the solu- 
tion is not unique. 


17. Solutions will exist everywhere 
and will be unique everywhere except 


742 
possibly along - = 0. Separation 
of variables = (x -1+ ¥73)? 


passes through (1,3). There is no 
problem regarding uniqueness at the 
given point (1,3). 


19. Solutions will exist everywhere 
and will be unique everywhere ex- 
cept possibly along y = 1. Separa- 
tion of variables > y = 1 + (32)3/? 
passes through (0,2). Since y = 1 
also passes through (0,1), the solu- 
tion is not unique. 


Section 2.3 


1. (ii) y* = —% is unstable; (iii) for 


yo < —3, y 3 —co as & > &; for 
Yor —z,Y 7 AL > OW, 


2.3461 (i), (ii), (iv). 


3. (ii) y* = —2 is stable; y* = 3 is 
unstable; (iii) for yo < —2, y > —2 
as x + oo; for -2 << 4% <3, y> 3 
as x — oo; for yo > 3, y ~ as 
L —> 00} 


2.343 (i), (ii), (iv). 


5. (ii) y* = —2 is half-stable; (iii) 
for yo < —2, y > —2 as x > &; for 
Yo >-2,y> was row; 


Answers to Odd Problems 


2.3445 (i), (ii), (iv). 


7. (ii) y* = 0 is half-stable, y* = 2 
is stable; (iii) for yo < 0, y > 0 as 
x — oo; for0 < yo, y > 2as x% > ~w; 


’ uf 
y 
2 
\ 2 ‘ 
| 0) x 


2.3447 (i), (ii), (iv). 


9. (ii) y* = —3,3 are unstable, y* = 
2 is stable; (iii) for yo < —3, y 4 —o0 
as © — oo; for -3 < yo < 2, y > 2 
as x — oo; for yo > 3, y 4 o as 
x —> 00} 


2.34¢9 (i), (ii), (iv). 


11. (ii) y* = +7 are stable, y* = 0 
is unstable; (iii) for yo < —7, y > 
se Bae ase tok te Sy, = 
y > —7 as © > oo; for 0 < yo < 7, 
ym as x —- 00; for yo > 1, y > 7 
as © —> 00; 


Answers to Odd Problems 


13. (ii) v* = Ve is stable; v* = 


—,/ a is unstable but not physi- 


cally meaningful (so ignore for rest 


of problem); (iii) for v9 > is 
vU—- l> as t > 00; 


= i t> 


2.3418 (i), (ii), (iv). 


15. (ii) a* = 2 is stable; (iii) for 
Xo € (—o0, <a). x—+>2ast— oo; 


2.3415 (i), (ii), (iv). 


17. (ii) 2* = 0 is unstable; x* = 1 
is stable; (iii) for 79 < 0, 7 + —oo as 
t > oo; for x9 > 0, e > 0 ast > cw; 


743 
x 
x! 
— 
0 Xx 
0 t 
2.34417 (i), (ii), (iv). 
¥s : x 2 
19. (ii) e* = 1,—1 is stable; x* = 5 


is unstable; (iii) If ¢ > 1, 7 > 1 as 
too. If} <a<l,r4las 
t> ow. 
If-l1<a<}$,2+-lasto. 
Ifa<-l,zw«>-last4 ow. 


0).08 


2.34£19 (i), (ii), (iv). 


21. fly) =y?—1 => fily) = 2y. 
Equilibria are y* = +1; 

fi(-1) < 0 => y* = -1 is stable; 
f'(1) > 0=> y* =1 is unstable. 


23. fly) =y? +1 => f'(y) = 8y’. 
Only real equilibrium is y* = —1; 
f'(-1) > 0 = y* =-—1 is unstable. 


25. r<0=> y* = —\/-, is stable 
and y* = /—r is unstable. r > 0 > 
no equilibria saddlenode bifurca- 
tion. 


27. r< 05> y* = 0 is stable, y* = 
—r > 0 is unstable. r>0> y* =0 
is unstable, y* = —r < 0 is stable => 
transcritical bifurcation. 


29. It’s stable. 
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Section 2.4 


1. (a) = 0 is half-stable, x = 1 is 
stable. For logistic equation, x = 0 
is unstable and x = k is stable. Yes, 
they are different. (b) For small z, 
logistic model growth is larger. 


3. « = 0 - Stable, « = 2 - Unstable, 
x = 10 - Stable 


5. (a) a = 0,1,4; 2* = 0 is sta 
ble; «* = 1 is unstable; z* = 4 is 
stable. The stability results do not 
differ from that of the Allee effect. 
(b) For small x, this model is approx- 
imately a’ = —4a? whereas the com- 
parable Allee model would be 2’ = 
—4x; the population in this model 
dies off at a much slower rate than 
in the Allee model. 


7. (a) v* = 0,4,5; 2* = 0 is un- 
stable; z* = a is stable; x* = 5 is 
unstable. 

(b) For 0 < to < 5,2 > aast > oo; 
for 29 > 5,4 > coast>o. 

(c) The parameter a could be a mea- 
sure of the health of the individual or 
the strength of their immune system. 
If a person had a compromised im- 
mune system, then the body will not 
be able to keep the bacteria in check 
at low levels but may still be able to 
keep it in check at higher levels. 


9. x’ = x(x—1)(a%—6)(ax— 10) is one 
possibility. 


11. (a) 2! = 27(2—2x)?(x — 4); 

(b) a* = 0,2, 4; 2* = 0 is half-stable; 
x* = 2 is half-stable; x* = 4 is un- 
stable. 


13. Letxr=X 


RT =rt. 


Answers to Odd Problems 


Section 2.5 


Ly ans 9): = 


Euler 
Li Yi 


ka? 7 


tks 
ka? 


kaka 
k3 ? 


1. 
Explicit 
y(xi) 


1.0 1 
Lal 1.1 
1.2 | 1.2331 
1.3 | 1.4059 


(a) 


1 
1.1160 
1.2684 
1.4640 


1.4 


Xi 


1.6256 
Runge-Kutta 


1.7104 


Yi 


Explicit 


y(xi) 


1.0 
1.1 
1.2 


(b) 


3. y' = xy, 


1 
1.1160 
1.2684 


y(1) =1. 


1 
1.1160 
1.2684 


Xi 


Yi ¥ 


1.0000 
1.1000 
1.2000 
1.3000 
1.4000 


1.0000 
1.1000 
1.2611 
1.5225 
1.9574 


Li 


Yi y(xi) 


1.0000 


1.0000 
1.1299 
1.3467 
1.7204 
2.4003 


y(m) = 2. 


Yi y(xi) 


2.0000 
2.0000 
1.9988 
1.9963 
1.9925 


Yi y(ai) 


— 
oa 
ue 


2.0000 
1.9994 
1.9975 
1.9944 
1.9901 


Answers to Odd Problems 745 


7. y/ =e, y(0) =2. vi yi__|_y(vs) 
vy Yi y (xi) 0 0 0 
0.0 0) 2 0.1000 0 0.0052 
0.1 92 9.9155 0.2000 | 0.0100 | 0.0214 
0.2 | 2.4300 | 2.4641 (a) 0.3000 | 0.0310 | 0.0499 
0.3 | 2.6929 | 2.7492 0.4000 | 0.0641 | 0.0918 

(a) 0.4 | 2.9917 | 3.0743 0.5000 | 0.1105 | 0.1487 
0.5 | 3.3298 | 3.4433 0.6000 | 0.1716 | 0.2221 
0.6 | 3.7107 | 3.8603 0.7000 | 0.2487 | 0.3138 
0.7 | 4.1383 | 4.3299 0.8000 | 0.3436 | 0.4255 
0.8 | 4.6165 | 4.8568 Li Yi y(x;) 
Li Vi y(x;) 0 0 0 
0.0 2 2 0.1000 | 0.0052 | 0.0052 
0.1 | 2.0134 | 2.0134 0.2000 | 0.0214 | 0.0214 
0.2 | 2.0267 | 2.0267 (b) 0.3000 | 0.0499 | 0.0499 

(b) 0.3 | 2.0398 | 2.0398 0.4000 | 0.0918 | 0.0918 
0.4 | 2.0527 | 2.0527 0.5000 | 0.1487 | 0.1487 
0.5 | 2.0655 | 2.0655 0.6000 | 0.2221 | 0.2221 
0.6 | 2.0781 | 2.0781 0.7000 | 0.3138 | 0.3138 
0.7 | 2.0905 | 2.0905 0.8000 | 0.4255 | 0.4255 
0.8 | 2.1028 | 2.1028 


13. See graph. 


9. y’ =y+cosa, y(0) =0. eee 
vj Yi y(x;) ad 

0 0 0 1.25 

9.1000 | 0.1000 | 0.1050 ee 
9.2000 | 0.2095 | 0.2200 0.5 


0.3000 | 0.3285 | 0.3450 
0.4000 | 0.4568 | 0.4801 
0.5000 | 0.5946 | 0.6253 Graph for 2.5713. 
0.6000 | 0.7418 | 0.7807 
0.7000 | 0.8986 | 0.9466 
0.8000 | 1.0649 | 1.1231 
L5 Yi y(xi) 

0 0 0 
0.1000 | 0.1050 | 0.1050 


0.2000 | 0.2200 | 0.2200 oe ee 
0.3000 | 0.3450 | 0.3450 


— 
o 
<= 


1 2 3 4 


15. y! = xy — zy’, y(-1) = 1. 
Take h = .001 viewing window to be 
-l<a<10,-l<y< 10. 


(©) | 9.4000 | 0.4801 | 0.4801 a oe 
0.5000 | 0.6253 | 0.6253 my 
0.6000 | 0.7807 | 0.7807 Graph for 2.54415. 
0.7000 | 0.9466 | 0.9466 
0.8000 } 1.1231 | 1.1231 17. y =yVa? +y* +14 cos(zry), 


y(0) = 1. Take h = .01 viewing win- 
11. y’ =a+y, y(0) =0. dow to be —.5<a<1,-1l<y< 20. 


5 0 0s 1 
xX 


Graph for 2.57417. 


Section 2.6 
1. y= cek® , y! = kce®* , y” = 
yy" = cek® x k2cek® = C2 22h = 
(y')? 

dy R? 


3. Substitution gives vf? = —giz- 
Separating, solving, and applying the 
IC gives v = +)/29R(2 —1)4 3. 
The “+” corresponds to the object 
going away from center of earth; the 
object “escapes” if the radicand is al- 
ways nonnegative. Since —> 0 as 
Io > —29R+v > 0. 


Chapter 2 Review 


1. False. Neither f nor a is contin- 
uous everywhere. 


3. False. RK use four function eval- 
uations to calculate the next step. 


5. True. 


7. (i) Solutions exist everywhere; 
(ii) solutions are unique everywhere. 


9. (i) Solutions exist everywhere; 
(ii) solutions are unique everywhere 
except possibly along y = 0. 


11. (i) Solutions exist everywhere 
except possibly when y = 5 4 
for n = 0,1,2,---; (ii) solutions are 
unique everywhere except possibly 

when y = 24+ nza for n= 0,1,2,:--. 


Cc 7 


Answers to Odd Problems 


13. (i) Solutions exist everywhere 
except possibly along « = —1; (ii) 
solutions are unique except possibly 
along « = —1. 


15. See graph. 
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Graph for Chap 2 Review #15. 

17. (a) «* =a is stable; «* = 0,4 
are unstable. (b) 2 € (0,a) > a 
as t + 00320 € (a,4) 9 aast > 
00;%9 > 4 co ast > cw. 


19. Left picture matches (d); right 
picture matches (b). 


21. x«* = 0 half-stable; 7* = 2 un- 
stable; 2* = 4/3 stable. See graph. 


Graph for Chap 2 Review # 21. 


23. xv* = —3/2,5 are both stable; 
x* = —1 unstable. See graph. 


-3/2 5s 


Graph for Chap 2 Review # 23. 


Answers to Odd Problems TAT 


25. x* = —2,4/\/3 are both sta- i RKeyi_| Euler:y; 
ble; x«* = —4/V/3,2 are both unsta- 1.0000 | 3.1416 | 3.1416 
ible, ‘Seeioaaphn 1.1000 | 2.7742 | 2.6981 
1.2000 | 2.5144 | 2.4127 

»*, 1.3000 | 2.3210 | 2.2118 

3 ) 1.4000 | 2.1713 | 2.0621 
he 1.5000 | 2.0522 | 1.9459 

f # —\ 1.6000 | 1.9550 | 1.8531 

V3 1.7000 | 1.8743 | 1.7770 

1.8000 | 1.8061 | 1.7135 


Graph for Chap 2 Review # 25. . 
33. y/ = rs y(2) = 0. 
All answers are 0 because yo = 0 is 
an equilibrium point. 

27. r<lsy* = vVl-r is sta- _ 

ble and y* = —V1-—r is unstable. ae Bw ue, y(V2) = 1. 

r > 1 += no equilibria saddlenode v_| RKeyi | Eulersy: 


bifurcation. See graph. T.51) 1.1251) 1.1207 
2 1.61 | 1.2592 | 1.2495 


eee 1.71 | 1.4030 | 1.3868 

a 1.81 | 1.5571 | 1.5332 

7 a Z ,, ; 1.91 | 1.7222 | 1.6891 
as . 37. y= me a a y(r) = 1. 

— = a, | RK:y, | Euler:y; 

Graph for Chap 2 Review # 27. 3.24 | .5678 | .11153 


3.34 | .5110 | .11150 
3.44 | .4724 | .11148 
3.54 | .4435 | .11146 
29. r<1= y* = 0 is unstable, 3.64 | .4206 | .11144 
y* =1-r isstable. r>1>y* =0 
is stable, y* = 1 —r is unstable > 
transcritical bifurcation. See graph. 1. A unique solution is guaranteed 

: because coefficients are constant. Sub- 
stitution gives cy = cg = 2. 


Section 3.1 


3. A unique solution is not guaran- 


~s teed because a2(x) = x is zero at the 
TS IC. Substitution gives c; = cg = 0. 
4 Le a 
Graph for Chap 2 Review # 29. 5. d2(a) = 2" =0 when x = 0, 80 


Thm 3.1.1 does not apply. 
Any constants c, and cg will work. 


: 7. Solutions are guaranteed every- 
31. y! = 5%, y(l)=7. where except when x = 0. 
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9. Solutions are guaranteed for all 
(x,y). 


11. Solutions are guaranteed when 
x > 0. 


13. Solutions are guaranteed ev- 
erywhere except when 2 = 5 + nz, 
n=0,1,2,--- 


15. P(D)f; = 0, P(D) fo = cosx + 
4+sinz, P(D)f3; = —e~?* 


17. P(D)fi =82+2°, P(D)f.o =0, 
P(D) fs = —3sin 2x 


19. P(D)f; = 4e*, 
P(D)f3 = 2.cosx 


21. Q(D)P(D)(y) = 
P(D)Q(D)(y) = 3x cosa 


P(D)f2 = 0, 


23. PQ(y) = 1-asinz; QP(y) = 
—cosx — xsing 


25. Q(D)P(D)(y) = —5cosa4+3 sin x 
—82+327; P(D)Q(D)(y) = —5cosa+ 
3sin a — 8a + 3x? 

27. Q(D)P(D\(y) = 52° + 152? + 
21x2+21; P(D)Q(D)(y) = 523412224 
212+ 16 

29. (D—3) 
31. (D? +1 
33. (D— 

35. (D +8)(D +2)(y) =0 
D(D +3)?(y) =0 


(D — 2)(D? +2D + 4)(y) =0 


37. 
39. 
Section 3.2 


1. By definition: Set cyv+co(22) = 0 
for all x. E.g., choose cy = —2,cg = 
1 


—3sin +32 cos 2; 


Answers to Odd Problems 


3. By Wronskian: W(a) = 


de (E ce =e"(4+2) £0. 


5. Any solution looks like 

y = Ce~Sr) d=, Tf y, and yo are 
solutions, they differ by a multiplica- 
tive constant. Substituting then gives 
W (a) = 0 for all x, which shows lin- 
ear dependence. 


7. Lin. independent because W (x) 4 
0. 


9. Linearly dependent. Choose, for 


example, cy = 2, cz = —1, and cg = 
8. 

11. Linearly dependent. Choose, 
€.g., Cc, = 4, C= —1.5, C3 = —1. 


13. Lin. independent because W(x) 4 


15. Lin. independent because W(x) 4 


ad 


17. Linearly independent. 


19. Set cya + co|z| = 0 for all a. 

(a) On [0,1], we have |z| = «x so 
choose ¢, = —Cg. Thus set is lin- 
early dependent on {0, 1]. 

(b) On [—1, 0], we have |x| = —a so 
choose c, = cg. Thus set is linearly 
dependent on [—1, 0]. 

(c) On [-1,1], we need results of 
both a and b to hold, which can only 
happen when c; = co = 0. Thus set 
is linearly independent on [—1, 1]. 


(d) W(2x) =) =0 


= det é 


n [-1,0]. W(x) =det (7 5 


n [0,1]. Thus W(x) = 0 for all x 
even though {2, |a|} is linearly inde- 
pendent. 


act (77) =0 
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21. y=qrt+egring, y =at 
e(l+ing), y"=2 
xy" — xy +y = cof — 12 — Cot — 
cot iInzx+caex+coriIng =0 

Letting cj = 3, cg = —4 satisfies the 
IC. Theorem not violated since 
ao(a) # 0 on the specified interval. 


23. y= cya? + C22, 

y = 29 +2, y" = 2c1 

gy" —Qaey' +2y = 2x?(c,)—2x(2c,2? 
+g) + 2(c,x? + cox) = 0 

Theorem does NOT guarantee exis- 
tence of unique solution on (0,0) 
since ao(z) = Oat r=0. y= cya? + 
x is the general solution that satisfies 
IC (not unique). 


25. There are two functions and the 

equation is 2nd order. Both func- 
tions are solutions and W(a) =4 4 
0 = functions are linearly indepen- 
dent. 


27. (i) There are the same num- 
ber of functions as the order of the 
DE; (ii) each of the two functions are 
solutions; (iii) the two solutions are 
linearly independent, since W(0) = 


5 £0. 


29. (i) There are the same num- 
ber of functions as the order of the 
DE; (ii) each of the two functions are 
solutions; (iii) the two solutions are 
linearly independent, since W(0) = 
1 

5 #0. 

31. (i) There are the same number 
of functions as the order of the DE; 
(ii) each of the three functions are 
solutions; (iii) the three solutions are 
linearly independent, since W(x) = 


140. 


33. (i) There are the same number 
of functions as the order of the DE; 
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(ii) each of the five functions are so- 
lutions; (iii) the five solutions are lin- 
early independent, since 

W(x) = 8cos* x +8 cos? x sin? x £ 0. 


35. No. y=27?+4 is not a solu- 
tion. 


37. No, it’s not a fundamental set 
of solutions because sin x is not a so- 
lution. 


39. Yes, it’s a fundamental set of 
solutions. 


41. No, it’s not a fundamental set of 
solutions because there are not enough 
functions to consider. 


43. Yes, it’s a fundamental set of 
solutions. 


45. Yes, it’s a fundamental set of 
solutions. 


47. Yes, it’s a fundamental set of 
solutions. 


49. Yes, it’s a fundamental set of 
solutions. 


51. Yes, it’s a fundamental set of 
solutions. 


Section 3.3 


lL. y= xe” 
3. y = ze%* 
5. y=e 
7. y=sindzx 
9. y=1 

1l. y= 
13. y=a+1 
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15. y’ -—y=0 > e"*,e” are solu- 
tions. 


17. y" — 3y' +2y = 0 = e?”, xe” 
are solutions. 


Section 3.4 


: / / 4 3 
1. (i) wy = U2, Ug = —FUe + FU, 


IC: ui(0) = 0,u2(0) = 1; (ii) with 
h = .5,y(5) © 5.9617; with h = .01, 
y(5) = 5.9619. 


3. (i) uy = Ue, uy = —2ug — 10u, + 
sinx, IC: ui(7) = e,u2(m) = 1; (ii) 
with h = .5, y(8.14) = 0.12947; with 
h = .01, y(8.14) = 0.09996. 


5. (i) uy = ua, uy = —Su te IC: 
uy (0) = 0, u2(0) = 4; (ii) with h = 
5, y(B) © —1.9947; with h = .01, 
y(5) & —1.9994. 


/ ——_ Se Ic: 
= l1,u2(0) = 2; (ii) with h = 
: 5) & 5.7432; with h = .01, 

y(5) © 5.7317. 


9. (i) ut 
IC: ui (0) = 1,u2(0) = 0, u3(0) = 2; 
(ii) with h = .5, y(5) © 21.5134; with 
h = .01, y(5) = 21.5134. 


= Jas, 


/ / 
U2, Ug U3, U3 


11. (i) uy = ue, us = us, us = 
—Sugue—sin wpe Ic: u1(1) = 1, 
u2(1) = 3,u3(1) = 1; (ii) with h = 
5, y(6) & 17.8569; with h = .01, 
y(6) & 17.8326. 


: / / / il 
13. (i) uy = U2, Ug = Uz, UZ = ZU, 


IC: ui (1) = 1, u2(1) = 1,u3(1) = 0; 
(ii) with h = .5, (6) ~ —29.9164; 
with h = .01, y(6) + —29.9121. 


. — i — 
15. (i) uy = ug, uy = us, uy = Ua, 


uy = exp (—8u2+2u1), IC: ui (—1) = 


3, u2(—1) = —1, u3(—1) = 0, ua(—1) = 


1; (ii) with h = .5, y(4) © 80.0743; 
with h = .01, y(4) © 80.1260. 
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Section 3.5 
1, 4/2 
3. V/2e"/4 
Sy Berns 
7. Beiarctan(3/4) 
9. /5e7iarctan(1/2) 


11s 22 


13. z=1,4%3+is 


15. z= V2+iv2,-V2+iv2 

17. p(1+i) = 36; p(2i) = -7 + 24 
19. p(i) = i; p(2i) = -i 

21. p(2i) = =; p(2i) = e*(4 + 72) 


23. Re(e’”) 


25. Im(e(t+24)#) 


27. Re(V2e(*+7/4)) 


29. Re(/5e-*+#Ge—arctan(1/3))) 
31. 27cos 2x 

33. cos? x — sin? x + i2cosz sina 
35. —sinx +7cosx 


37. de" [cos 2x4 2sin 2x +i(sin 2x — 
2 cos 2x)] 


39. A, =—i, A, =1 


1+i 1424 
41. A; = +t, Ap = 
43. a! =ie™ 2” =e" S "+o = 


0 


Section 3.6 


Answers to Odd Problems 


Ts y(x) = ce? + core 2 
9. y(x) = cie?* sin x + cpe?” cos x 


11. y(x) = cre?” +c2e77* +c sin 24+ 
C4 COS 22 


13. y(x) = c1 cos 2a + cg sin 2a 
+ c3x cos 2x 4+ c4x sin 2x 


15. y(x) = cye” + core” + c327e* 


17. y(x) = cye~7* + cpe~* + c3€* 
ce” 

19. y(x) = cye~** + cope + c3€7 
ce?” + Cr 

21. y(x) = cy +c9u 4+ cge* + cque* + 


C5 COS Z% + Cg SIN Z 
23. y(x) = —e~* + e** 
25: 4a) =2e 7” 


—T-2x 


27. y= —,— sin3dr 


29. y = cos 2x + 4 sin 2x 
31. D?(D+2)(y) =0 
33. D*((D—2—3i)(D—2+3i))*(y) = 


0=> 
D*(D? — 4D + 13)3(y) =0 


Section 3.7 

1. x(t) = Zcosl6t; 4 ft; Z sec; = 
oscillations /sec 

3. a(t) = Zsin8t; + ft; 7 sec; + 


oscillations /sec 


7ol 


Rt 


7. [=}(-et 


) 
9. Q = Qoe CR) 

11. Q=VC 

13. Underdamped. 

15. Overdamped. 

17. Critically damped. 

19. Overdamped. 

21. Critically damped. 

28. (B—EwifEyi—& x 
iE a) a iV for small b. 


25. 1>k>0 


27. b=2V3 


29. y<m 


Na 
A 


Graph for 3.7#31. 


80 100 


33. sal 
Graph for 3.7433 with w = 10. 
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| -< 
PTTL 


Graph for 3.7#33 with w = 1. 
It seems w = 1 gives the largest os- 
cillations. Amplitude = 10. 


Chapter 3 Review 


1. False. We only can conclude that 
this is a possibility. 


3. True. The method won’t work 
without a solution. 


5. False. Only constant-coefficient 
differential operators commute. 


7. A unique solution is guaranteed 
because coefficients are constant. Sub- 
stitution gives cy = cg = 2. 

9. A unique solution is not guaran- 
teed at x = 0. The IC requires co = 0 


with any cy. 


11. A unique solution is guaranteed 
for all x. 


13. A unique solution is guaranteed 
for all x > 0. 


15. Linearly independent. 
17. Linearly independent. 
19. Linearly independent. 
21. Linearly dependent. 


23. Yes, it forms a fundamental set 
of solutions. 
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25. No, it is not a fundamental set 
of solutions because e~” is not a so- 
lution. 


27. No, it is not a fundamental set 
of solutions because neither is a so- 
lution. 


29. No, it is not a fundamental set 
of solutions because neither e?” sin x 
2% cos x are solutions. 


or e€ 
31. yo =e* 
33. yo =e >* 


35. (D—4)(D +3)(y) =0 
37. D(D—4)(D +4)(y) =0 
39. (D—1)3(y) =0 

41. y(5) © 1.63314 

43. y(6) © 18.56345 


45. (4) © —.52660 


51. p(i) = +54; p(2i) = 454 
53. p(2i) = + p(2i) = e*(4 + 12) 
55. y(x) = cre?” + ce3” 


( 
( 

57. y(x) = cpe7® +e +3" + cye* 
( 


L) = ce *+core~* +0327e77 + 
61. y(xz) = cre~™ + c9e°7* +3 + 


= (32 + 1)e~** 


65. y(x) = Le~4"(3e2* — 1) 
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67. y(x) = 
ze7(*—"/2) (5 cos 32 — 6 sin 3) 


ooo oO 
NB WD oO 


69. y(x) = 2-—sine 


71. Overdamped. -0.2 oa ae : aa 
73. Overdamped. Giaph woh plese 2. 
75. Critically damped. 
0.4 
77. b>4 0.2 
79. k=1 ; ; 
-0.2 
4 
81. m= 7 Graph for 4.149, w = 3. 
Section 4.1 
7 13. Resonant frequency w = J 3, 
Ll. w= amplitude 0.3. 
3. Yp = Fe cosa — Hsing 


5. Yp = Scosax 
Section 4.2 


— 991 5 
7 Up = 2(G) — 12(§ + 3g) + 6(), 1. yp = A+ Br+ Cx? + Ee* 
now simplify. 

3. Yp = Axsing + Bacosx 
9. Resonant frequency w = 2, am- + Ce* sina + Ee* cos x 
plitude 0.2. 
5. Yp = Axe** sinz + Bre?” cos x 
+ Ce” sing + Ee* cosz 
+ F sina + Gcos« 


7. Yp = Asinag + Bcosx 


eo oo © 


i 
8 
6 
4 
2 

awa = 
ee NIT fo HY 11, A=4,B=7 


Graph for 4.149, w =1. 13. A= B= qC= 7, F=0 
_~-=5 pLl-lnilipe 
15. A= 3f,B = 4,0 = 3, = 

50 


11. Resonant frequency w = \/1/2, 17. y(x) = cye~2* +. cne4* — 3e73% — 
amplitude 0.6. i ez 
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oo°0 36 
RB A wo FR 


i A es ARAAAAD 
“VX APTI TY 


Graph for 4.1411, w = 1/18. Graph for 4.14413, w = V3. 


10 


19. y(a) = cye” sinx + c2e” cosa + 


" ¥ (2+ %) cosx— 2 (5a +7)sing 

Ve \ ey s ‘e: ~” 21. y(x) = cre* sin 2x+c2e* cos 2a— 
a tae” cos 2x 
Graph for 4.1411, w = \/5/18. 23. y(x) = cie® sin 27+c2€” cos 2r+ 


1 x 1 ox 1 7 
gute” + zee" — gue cos 22 


10 


25. y(a) =c e 8? 4 epe-* 4 = (4a— 


27. y(x) = qe *” sinz+c2.e—** cos x 
+cge~*7 + 5a%e 474 52e “#456 


fl 
é 


Graph for 4.1411, w = \/1/2. 29. y= cere = Tet — 8% 
_ 31. y(x) — (1 =. x)e* 
0.8 
0.6 33. y= i, oe ee 32 gi pk 
es 3xe— 3% 3 cos — ge?” sin x 
0.2 


= i AVIV EV GRY AR 35. a. y(a) = ee" aie 47) 


Graph 4.1413, w =1. 
. # Section 4.3 


1. Yp = Ay + Aor + Agu? + Be~* 
3. Yp = Aixsing + Agx cos x 


+ Byie* sinx + bee” cosx 
op VP OTA vi i 5. Yp = A, ze** sina + Apre?* cos. x 


+ Aze?” sina + Aye?” cos x 
Graph for 4.1413, w = +B, sie Bo eone 


1 
8 
-6 
4 
2 


coo oe 


7. Yp = Ay sine + Ag cosx 


Answers to Odd Problems 


9. A= % 

_ il _ -7 
ll. A= 7p, 42=7 

8 1 

13. A; = 0, Ae = gy, A3 = 37, As = 
0 
15 Aj =, Ae 3B =7,B.= 
3 
50 
17. y(x) = ce?” +c9e4* — 3e- 3” 
i 2% 
Ze 


19. y(x) = cye* sina + ce” cosa + 
(2+ =) cosx— 2(52+7)sing 


21. y(x) = cye” sin 2x+c2e* cos 24— 


ae” cos 2a 


23. y(x) = cie® sin 2a+c2e” cos 24+ 


1 x 1 oz ij x 
5re” + zee" — gue cos 24 


25. y(x) = cre 3" +e9e-* + = (4a— 
2+ €?”) 


27. y(x) = ce ** sin r+cye~** cos x 


+cge"47 + fae 47 4+ bane **# + he 
— 1,22 T7,—25 _ 
29. y= 5e ze 8x 


31. y(x) = (1 — x)e* 


33, y= me, cos 2—iape sin 7+ 
3re~** — 5 e** cosa — gge** sing 


35. (a) y(x) = ce“ — F(a? +34 9); 
(c) y(z) = ce* + ze" 


Section 4.4 


1. Y= P(-1) 2 


Ae3® e728 
3. Up = Pay = 7 
= 3 3 
5. Up => P(0) = 
ei2e 
7. Yp = Re(3 faq) 


8 3 as 
= cos 2x” + 5 sin 2x 
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9. Wp = Boy = 
11. Y= a = ae 
13. Yp = Pe =a a 


—ome(—1 tie 
15. Y= Re(=Sraa) 


=-—xe *sinax 


17. P(D+1)u =2 => y = ve” 

(52 — 35)e* 

19. P(D+0)v = 2?+3r-1> 
= Ty ie ie 

Yp = gt" + 3h — gy 


21. Q(D) = D3, Q(D+(—3))u = 
L => Yp = (Fer — yw’)e™ 


23. Q(D) = D+1+41, Q(D+(-1+ 
i))u = (D+ 2i)u = 2? > u= fat 


2\4 — 1,2,-2 
)i > Yp = G2%e-* cosa + 


27. y(a) = cye” sinx + c2e* cosa + 


(2+ 4) cosa — £(5¢ +7) sing 


29. y(x) = ce ** sin +c2e73* 


+c3e 74% + qe + sxe 4 


COS X 


33. y(x) = (1— x)e” 


35. (a) y(x) = cre” — 3 (a? +24 8); 
(e) via) = er 4 Lele 


Section 4.5 


1. y(x) = c + coe + arctan se — 
5 n(x? + 1) 


xv 


3. y = Cie™ + Coxe" e* lInz—e 
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5. y = Ci sin 2x” + C2 cos 2x 
+ sin 2x cos x + sin x cos z In (tan ¥) 
— cos 2x sin xz 


T. y =Cy, + Cre + C3e* — 3 4+ 
x 9a? | 15x 17 
4 8 ' 8 16 


11. y(x) = cosa + In(cos x) cos x 
+2sinx + xsinz 


13. y(x) = 3(3 + 2cosa + cos 2z) 


= y(z) =—l+cosa+sing 


In(cos(5) + sin()) sin x 
) 


In(cos( sin($)) cosa 


N/Swl|B 


17. y(z) = 4a(Inz—-1)+2 

+ C2% + C3 

19. y(x) = $+c; sin(In x)+c2 cos(In 2) 
Section 4.6 


1. y(z) = cz? w 


+ cox 
3. y(x) = c, sin(2 Ina)+cp2 cos(2 In z) 
5. y(z) =x 3+ eer 7 
7. y(x) = cx + cgx3/? 
9. y(x) = cu? + cox? 1 


10. y(x) = cya! +V3 + egg} -v3 


11. y(x) = cyx72+V7 4 egg 2-V7 


13. y(z) = ce" sin (2 In x) 


+ c9x"/7 cos (2 In x) 


15. y(xz) = cq 275/3 sin Ce In) 
+ c927°/3 cos 2 In x) 
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17. W(z) = 3(my2 — vive) # 0, 
since y1, yg are linearly independent. 


19. y=4 2ing+Inz 2 
Section 4.7 

_ 5 = 
1. g(w) Vitor isar res 3 
Gain for 4.7#1. 
3. g(w) = Jerparpieae Wres = 0 


Gain for 4.7#3. 


5. I(t = Ce 4% + Cp» e200 


cos(10t) + 42% sin(10¢) 


632 
+ $817 6817 


11. ma” = —kx + d(y’ — 2’); y = 
sinwt > ma” + ba’ + kx = bw coswt 


Chapter 4 Review 


1. True. 

3. True. 

5. False. 

7. Yp = 2(-®) + $(6x + 1) 

9. yp = He?” — FS cos 2x— Ht sin 2a 


11. yp = —xe~** cos4x + ee” 


Answers to Odd Problems 


13. y(x) = cre* +c2 — Fe (4sina + 
cos x) 


15. y(ax) = cje* + cgze* + Ge ™* 


23. y(x) = c, sin (5 In) 


+ ce cos (ine) os 


25. g(w) = Foaaparpaae Wres = 


V15 


Section 5.1 
cost || ees et 

1. 3] 13 32{+C 
i Sa Be 
cost e! 

: ie ar 

—cost et 

| 8 e|+C 
3 "2: 


ef a et Qe2t 
t —e? 3c. 
zt? 0 sc C 
a 
e—*(cost — sint) —3e3 —3e7% 
¥. ii 43 —sint 
441/83 0 3te®! + 
3t 
se 
t2 2e3t Cc 
el 
e —et e€ 
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—4de—2t 
dx 
11 Ta ee = Ax; 
o —3e—** 
a2 -_ ( seat | = Ax2 
et 
13. S1 =| 0 | = Ax; 
0 
0 
dx2 — | —e~# | = Axa; 
0 
— et 
os. = 0 => Axg 
2e2t 
—2e72# 
15. 92 =| 6e-% | = Axi; 
Qe 2t 
et 
Re — —2e-* i Axe; 
0 
et 
a = 0 => Axg3 


17. Linearly independent. 
19. Linearly dependent. 


21. Linearly independent. 


23. Linearly independent. 


25. Not a fundamental set of solu- 
tions. 

27. Yes, it is a fundamental set of 
solutions. 


29. Yes, it is a fundamental set of 
solutions. 
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Section 5.2 


1 4 3 
wh fs 3] 


fe SF oo dl 
5 {1 0 -1 3 —-2 
23 -9 3 8 


Us t2 = —2,21 =11 


9. £3 ep) 
11. t =t,73 = 1+ 2t,x7, =64 9t 
13. ty = —1,22 =2 


15. Infinite solutions: v2 = t,x7, = 
3 — 2t 


17. Ly 4, x2 —3,2%3 2 


19. Infinite solutions: 73 = t,x = 
2+ 2t,2, = —1—7t 


Section 5.3 


1. (i) There are the same number of 
vectors as the dimension of the vec- 
tor space; (ii) each of the two vec- 
tors is in the correct space, R? in this 
case; (iii) the two vectors are linearly 
independent. 


3. (i) There are the same number of 

vectors as the dimension of the vec- 
tor space; (ii) each of the two vec- 
tors is in the correct space, R? in this 
case; (iii) the two vectors are linearly 
independent. 


5. (i) There are the same number 
of vectors as the dimension of the 
vector space; (ii) each of the three 
vectors is in the correct space, R? in 
this case; (iii) the three vectors are 
linearly independent. 
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7. (i) There are the same number of 
vectors as the dimension of the vec- 
tor space; (ii) each of the four vec- 
tors is in the correct space, R* in this 
case; (iii) the four vectors are linearly 
independent. 


9. Yes, it is a basis. 
11. Yes, it is a basis. 


13. No, it’s not a basis because vec- 
tors aren’t in R°. 


15. No, it’s not a basis because vec- 
tors aren’t in R°. 


17. Yes, it is a basis. 


19. No, it’s not a basis because 
there aren’t enough vectors to span. 


21. No, it is not a basis because 
vectors are linearly independent. 


23. One needs to show that each of 

the 10 conditions in Definition 5.3.1 
holds. For example, show that (i) a 
3x3 matrix added to one of the same 
size is again a 3 x 3 matrix; (v) the 
3 x 3 matrix of zeros added to any 
3 x 3 matrix A is just A. 


25. Label the matrices A, --- Ag. It 


is clear that 
cA, C2 Ag c4 Ay = < | 
C3 C4 


spans R?*? and it is also clear that 


cA, co Ag c3A3 aAs= (0 | 


C3 C4 
00 ; 
= E 4] only if 


C1, C2, €3, C4 all are 0. Hence, they 
are linearly independent and so they 
form a basis. 


€3A3 


Answers to Odd Problems 


27. One needs to show that each of 

the 3 conditions in Definition 5.3.5 
holds. For example, show that. (i) 
(0,0,0) is in the plane « = 0. Simi- 
larly for (ii) and (iii). 


29. One needs to show that each of 
the 10 conditions in Definition 5.3.1 
holds. For example, show that (i) an 
m X nm matrix added to one of the 
same size is again a m xX n matrix; 
(v) the m x n matrix of zeros added 
to any m xX n matrix A is just A. 


a. a ={(}].[°]}. 


null(A) = 0 


= na={(3) [)} 


micay= | —3 


om -{( 
3 —1 
null(A) = = ’ : 
4 0 
1 
37. R(A) = =| \ 
1 


wus -{C 


39. Any matrix with reduced eche- 
lon form that contains two non-zero 
pivots. 


41. Answers will vary. For example, 
1 0 0 
0 1 0 
0 0 1 
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43. Answers will vary. For example, 


49. R(A7) = 


= 
null(A7) = | | 1 
0 


Section 5.4 


13. Ay = 5,A2 = 1, 
_ {il ie 
Vi = 1 Vv2> 3 


(6.35 0. 3 4, 


Skea 


19. M12 = 12 

a 
a os H »V2>= V1 
21. A1,2 = 1 


29. Mt = 2,rA9 = 1,rA\ = —-4; 


1 0 1 
Vi= 2 ,Vv2= 0 V3 >= -1 
0 1 1 
—1+2i 

31. A1,2 = 2221, Ivy = 1 
0 

—3 

Vo = Vji,V3 = —1 


5 


Answers to Odd Problems 


0 
Vi= 0 ,Vv2 => 2 »>V3 = —3 
1 0 1 


35. ul, = 2u1, us = 3ug; 
x = 2c,e7* + ege**, y = ce?" + coe** 


37. ui, = 5u1, us = —3ug; 


x = 4cje"', y = qe! + coe ** 


39. ul = —U1, US = U9; 
xz=ce'+cet,y =cye* + 3c2e! 
7 = ce cge',y =c1e "+ 3C2€ 


of JR IGT 


43. \= +37 


“J 
fa 
— 
oh 
~~ 
| 
iv) 
fa 
ao 


Answers to Odd Problems 


17. x(t)=c ce e3-732t 
ke eal She 
19. x(t) = 


iw) 
f_ 
fal 
— 
+ 
Ww 
l| 


23. x(t) = 

e "cy fe cos 2t — 5 sin 2t 

+a([2 |simae+] | eos2r) 
3 1 

25. x(t) = 


t 
0 Dass 
e ey (Hl cos 2t — 0 sin 2t 


+e ey (ql sin 2¢ + 3 cos 2) 


27. x(t) = coe” + c3e* 
y(t) = —cge7* + ae", 
z(t) = cet + 4cge* 4 zo3e" 


29. x(t) =e "(c, sin 2t + cp cos 2t), 
y(t) = e~*(—c1 cos 2t + cy sin 2t) + 
$c3et, z(t) = c3et 

31. x =c,et/? sin(¥5t) 

+ cget/? cos(48t)), 

y = tet/? (3c, + VT5c2) sin(¥8t) 
+(3c2—v 15c,) cos(¥252)), — c3e! 


33. r= —1,-3,2 = cet + ee *# 
rv =y;y! = —3x — 4y, 

Eigenvalues A;,2 = —1,—3, Higen- 
vectors v1.2 = [1 —1]7,[1 — 3]. 
Solution is again x = cje~’ + cpe~*" 
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35. z(t) = —896.64e—-16597¢ 
— 1398.4e~-29403t + 12995.1, 
y(t) = 66.898e— -16597¢ 

+ 2342.9e--29408¢ +. 9590.2, 
e(t) = 829. 74e—100e™ 

— 944,50e—-29403? +. 8114.8. 


Graph for 5.5435. 


Section 5.6 


i eset he | 


c2 
2 


Beata - 


ci + cot 
2c1 + c2(2t — 4) 


. 


c1 + c2( (t— 1) 
Cy + Cot 


C1 a cot 
402 
cy + C2( (t +4 
Cy + cat 


11. x ~e1 + €2(— " 


cyt a 


1, Ape Ag 


2, A3 =1; 
1 


uy = 1 


+ c9e7! _ c3e 
= ta”) _ coe 


x(t) = ete” 
y(t) =cr(e" 
z(t) = c3e" 


+ c3e! 
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15. Ay =—l, A= 1, A3 = 1; 


—1 —1 
Vi= 0 , Vv2=> 2 
0 —4 
1 
uy = 1 
0 
x(t) = cie* — <cee* 


+c3(#e! — Ste’), y(t) = coe’ + cgte’, 
z(t) = —2cge’ + c3(e’ — 2te*) 


17. M1 2, AQ 2; A3 2; 
0 0 
Vvi= 0 > V2>= 1 
1 0 
—1 
uy = 1 
0 
x(t) = c3e”" 
y(t) = cpe”# 
z(t) = (cst + cot + c1)e”* 
19. Mt 2, r2 2, A3 2; 
1 1 
v=|-l , ut = 0 
1 1 
1 
ug = 0 
0 


x(t) = —e7*(e, + ten + co + teg + 
2tcs+2c3), y(t) = e~*(c1+tc2417c), 
z(t) = —e—*(e +te2-+e2+42c3 +4 2tcg) 


21. Mt il, A2 Ls A3 1; 
—1 0 
v=|-l1|],u=| 2 
0 -1 
1 
ug = 0 
0 


x(t) = e'(c, + teg + tes), y(t) = 
et (ce, + tee — 2cz + t7c3 — 4tc3 + 2c3), 
z(t) = e'(cg + 2tc3) 


23. Matrix already in Jordan nor- 
mal form with only 3 eigenvectors, 


Answers to Odd Problems 


one for each of A = 1,2,3. Gener- 
alized eigenvectors are the basis vec- 
tors, €1,...,€6. 


x1(t) = Cre" X(t) = (Cot + Cy)e**, 
x3(t) — Cre", 

x(t) = (Ce + Cst + 5C3t?)e*, 
x5(t) = (C3t+Cs)e**, x(t) = C3e%", 


Section 5.7 


et 0 
fe 


= 


2 2 
e** cos2t —e®* sin 2t 
—e*' sin 2t e®’ cos 2t 
—tcos3t —e-'sin3t 
11 e* cos e sin 
e-'sin3t  e-' cos3t 
a, a2 a3 
13. | 0 ef 0 | , where 
by by bg 
_ Qe~2* + et 
di RB] ’ 
_ —2e~7'42e'+3te? 
a2 — = Qa 
—2t t —2t 
a3 = —2e +2e . by — =e +e . 
—2t t t —2t £ 
e —e'+3te e +2e 
by = 5 , OO 3 
e7§ ay a3 a4 
15 by bo bg bg 
: 0 0 ee 0}? 
Ci, C2 Cg C4 
where az = —e~* + e”*, 
— —e **—5e7*+6e”* 
ee ae’ 
a4=e "—e”, 
e2t_ edt 
by = ’ 


Answers to Odd Problems 


bs _ ~—8e73t4+e7*+4+367+~ et 
_ 10 , 
b _ —2e~*—5e?*+7e4# 
4 — 10 ’ 
2b te 
gq = = 7 ; 
ny x Be * e436" 
2— 10 ’ 
en 2e-3t_de-t43¢2t_ et 
3 10 ’ 
ap Be *_5e?t+7e4# 
4 10 
1 -2 
17." 
0 Ll? 
p(t 3 
~ 1 0 —1]’ 
ult 4 
~ 10 1 
‘a a” nat 
* |) 0 a” 
24 e %# 4 Qe-# e ‘+e 
* 2e to 2e 3t 3t 
23. = 
et—e* eb+et 


e cae sin 


ai 


ae 3t sin(2t) e%¢ cos(2 


a, 
ak 
« 
J 
yD, 
| 
sf 
re acy 


27. 


31. 
33. 
35. 


i: 
Lyon" 
29. p(A) = 
Pp 
p 
Pp 
37. p 


39. p(A) = A?+4A +131 =0 


Section 5.8 


Ie a= Se 66") 
— 2a e~2#(—1 + @), 
SEL e—2t (_ 1+ e*) 
+ Ben 2t(_1 + 6e°*) 
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3. 2(6) =e", 
y(t) = =re2(—1 +o) 
+ coe?! 


5. x(t) = cye’ — cz3e~*(—1 + e”*), 
y(t) = cje’(—1 + e*) + cae” 

+ cge7*(—2 + e2* + €%*), 

z(t) =cse* 


x(t) = cye** + cge7* + cf 


3t 1, 4—2t 
sec, — 5e2€ 5 


9. x(t) = coe** — L cost — 


dt 6 
35 cost 


sin t, 


i 
35 sint 


7 


11. x(t) = (t+ ca)e’ + cge, 
y(t) = cre" —(1+t+c)e’— 2 cost 
2 

5 


13. x(t) = e%c, + coe — ef — 
= cost + 5 sint, 

y= = cae", alt) = ce — teen — 
5 1 sint — Ze! 


Chapter 5 Review 


1. False. A full set of eigenvectors 
may not exist. 


3. False. 
5. False. 
7. True. 
9. Yes, it is a fundamental set. 
11. Yes, it is a fundamental set. 
13. No, it is not a fundamental set. 
15. Yes, it is a fundamental set. 
17. Yes, it forms a basis. 
19. Yes, it forms a basis. 


21. No, it is not a basis because 
vectors are linearly dependent. 
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23. No, it is not a basis because 


vectors are linearly dependent. 


25. Yes, it forms a basis. 


a7 r(4)-1| 2 | §, 
=| 
null(A) = {| 
n.nwr-{(} 
null(A) = |} 
1 
—1 2 
31. R(A) = = >| Tl?» 
ube 1 
null(A) = 4 | -6 
5 


1 
1 
(ii) x(t) = ce* + ee, 
y(t) = ce” — 3cge~** 


Vi= 


1 —|-li. 
a9 »V2 a 1 ’ 
a(t) = —cje*+c2e~™*, y(t) = cre~ 


1 =i), 
w=[i)=[5) 
x(t) = ce" + coe-*, 
y(t) = ce + Senet 


t 


Answers to Odd Problems 


Al. 
y(t) 


43. 1 = 4i, Ap = —4i, 
_f 1 fa 
Va | ai | 0%? = | 4 
45. Ay =2+i,r2 = 2-1, 
—3-i —3+i 
Vi= 1 +Vv2 = 1 
47. dy = 44+ iV3, rp = 4-iV3, 


_—— F iva _—— Laval 


(iv) x(t) = 2c; cos 4t+2cz sin 4t, 
= —c, sin 4t + cp cos 4t 


49. ui, = —2u1, uy = 2ug; 
x = ce** + cge7*, 
y = cye** + Se9e-*# 
2 
51. Mi ,2,3 = —2,2,3, U= —1 5 
2 
1 2 
v2 = -1 5 UZ = -1 
il 1 
—1 
53. Mi,2,3 — —1,1,5, U= —1 5 
1 
1 1 
v2 = 1 , v= —1 
1 1 
55. Mi,2,3 = 2, 1,0: U= 
1 —1 —1 
—1 U2 = -1 » V3 = -1 
1 2 1 


. | ce’ + cate! | 
=i) 3 t 3 t 1 t 
5C1e" + Cate’ — aCe 


Answers to Odd Problems 


5cne%! 
0 
63 A1,2,3 = 1,-1+ 2%, VF 1 
2 
a 4 
Vv2=> Vv3= al 3 
0 0 
0 


65. A123 = —1,-1lti,vi= | 1 
1 


67. (i) M1,2,3 = 2,—2 pie di, Vi= 


3 
0 ? 
5 
—1 a 
v2= 1 v v3 >= 1 t 1 ; 
1 1 
69. (i) \y =1,A2 = —1,A3 =5, 
1 1 1 
Vi= 1 ,Vv2 = 1 ,Vv2= —1 
1 —1 1 
71. (i) Ay =—3,A2 = 5,43 = 1, 
—1 1 1 
Vi= —1 ,Vv2 = —1 v3>= 1 
1 1 1 
73 (i) M1 1,2 1, A3 2 
—2 0 1 
Vi= 1 ,Vv2 = 0 vV3>= —1 
0 1 1 
75. (i) Ar = -2,A2 = —2,A3 = 1, 
=1 —2 12 
Vi= 1 ,uy = 0 V3 = 0 
1 1 0 
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77 (i) v1 —_ 9, A2 = —12, A3 _ —12, 
1/3 0 
Vu= 0 ,Vv2=> 4 , 
0 —2 
2/3 
uy = 0 
-1/3 
79 (i) A1,2.3 = 6, 
0 —3 
Vi = —18 ,~u, = 15 ,Uug = 
9 —6 
1 
0 
0 


81. 


83. 


87. . 
et cost —e*sint 


85. | z(e'+ 2c)  F(e*t—e*) | 
89. x(t) = ce" + ce”, 
y(t) = ce** — 3cge77* 


91. x(t) = cye’+ce™, y(t) = 5epet+ 


93. x(t) = cre~*! + coe*® + cge3! + 
acyl) = + ce cne2! $c3e%" 
— Fe’, z(t) = ce"* + ce* 

+ sc3e" + Het 

Section 6.1 


1. y =—-3 = Saddle 


Graph for 6.141. 


Answers to Odd Problems 
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Graph for 6.1411. 


ae 4, 8? 


B 


13. y=7 
Unstable Spiral 


= 


Graph for 6.143. 


5. y = —5 => Saddle 


Graph for 6.1413. 


—40 = Saddle 


15. 7 


Graph for 6.1455. 


Unstable Node 
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Graph for 6.147. 


>1+4+d; 


) 


b 


d— 


( 


,4 


(c)d>b,1+d>0 
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d 
3 — 62; (ii) unstable; 


21. 


Graph for 6.149. 
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win¥es 


25. (i) Ar = —3, A2 = 5, A3 = 1; (ii) ae 
saddle sia 


ies] 
27. (é)\1,2 = 2+ 2i, 1; (ii) unstable + \ =< \\ 


Section 6.2 


6.247 


1. (x*,y*) = (2,0) is a saddle; 9. (a*,y*) = (0,0) is an unstable 
(2,0) is a linear center. node; (3,0) is a stable node; (0, 2) is 
zt a stable node; (1,1) is a saddle. 


6.241 
6.249 
3. (a*,y") = (0,0) isasaddle; (—2,2) 11. (a) a = 0,6’ = —2sin@; (b) 
is an unstable spiral. Equilibria (0,7): stable at (+27, 0), (0, 0) 
cee — and saddle at (+7,0); (e) see Fig- 


ure 2.27; pendulum at stable equilib- 
ria is hanging straight down, at sad- 
dle equilibria is inverted straight up, 
center orbits is back and forth mo- 
tion, orbits above saddle are whirling 
over the top motion. 


13. Solutions do not cross in t-x- 
x’ space, which is guaranteed by the 


a. . H 7 Ue 2 i avanti Existence and Uniqueness Theorem. 
Hn, , , , However, when you project. these so- 
TSX Capo eerras er 4 lutions onto the x-z’ phase plane, the 
ad Daten fas ah trajectories may cross. 
“Hg jpn 15. (a) (0,0,0), A12,3 = —10.525, 
wi eee Ee — .475, —2.667 = stable node; 


(b) (0,0, 0), A1,2,3 = —11.844, 

0.844, —2.667 = saddle; 

(—1.633, —1.633, 1), (1.633, 1.633, 1), 
Ai2,3 = —11.242, —1.212 + 71.809 

7. (a*,y*) = (1,1) isastable spiral; | => both stable spiral; (c) (0,0,0), 
,1) is a saddle. da.2.9 = —21.939, 10.939, —2.667 > 


— 
a 
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saddle; (—8, —8, 24) and (8,8, 24), 
A1,2,3 = —13.682,0.008 + 79.672 > 
both saddles (unstable spiral but sta- 
ble in 3rd direction). 


6.2#15; IC (1,0,40) with r = 25. 
Section 6.3 


1. For r > 0, (2*,y*) = (vr, 9), 
(—/r,0); for r > 0, (./7, 0) is a sta- 
ble node, (—/7,0) is a saddle; for 
r = 0, we have (a*,y*) = (0,0) is 
the only equilibrium and its stability 
cannot be determined by lineariza- 
tion; for r < 0 there are no equilibria. 
The system undergoes a saddlenode 
bifurcation. 


3. (a*,y*) = (0,0), (r,r). For r < 
0, (0,0) is stable and for r > 0 it 
is a saddle. For r < 0, (7,r) is a 
saddle and for r > 0 it is a stable. 
The system undergoes a transcritical 
bifurcation. 


5. For r > 0, (x*,y*) = (v7,0), 
(—,/r,0), (0,0); for r > 0, (4/7, 0) 
are both stable nodes, (0,0) is a sad- 
dle; for r = 0, we have (a2*,y*) = 
(0,0) is the only equilibrium and it is 
again a stable node; the system un- 
dergoes a supercritical pitchfork bi- 
furcation. 


Answers to Odd Problems 


7. See figures for r = —.25, .25. 


6.347 with r = —.25; an unstable 
limit cycle is present because one tra- 
jectory spirals into the origin while 
the other spirals away from the ori- 
gin. 


6.347 with r = .25; there is no un- 
stable limit cycle and both trajecto- 
ries spiral out of the origin. 


9. Rewrite as 2’ = y, y’ = —y(a? — 
€)—a. Equil. at (0,0). Characteristic 
polynomial is \? — e\ +1; imaginary 
part requires « = 0. There is a stable 
limit cycle for « > O and no limit 
cycle for € < 0. 


11. Substitute coefficients to obtain 
b= = < 0 => supercritical Hopf 


bifurcation. 


Section 6.4 


1. We're given + = 3.5 days. Thus 


a 


Be +4 x 403. 


3. (a)i-Glns+s=C 
(b) #*—G Ins*+s* = 4(0)—§ In s(0)+ 


Answers to Odd Problems 


s(0) 
() 2-5 


5. (a) s’ = 4 => s(t) always becomes 
and remains positive gives; (b) i! = 


0 => ig = 0 gives i(t) = 0. 


9. (a) S’+1'/+R’ =0 => N =constant 
= ignore R’ equation; (b) (S$,I) = 
(S(0),0); (c) requiring Tr< 0 gives 
the condition. 


11. Ro = ao and this — 


to the previous expression Rp = re) 
when v = 0 (as it should). 


13. Consider S,E,J for the vari- 
ables in the reduced system. Ro = 
rae Average life span for the 
infectious class is ee so 3 repre- 
sents the total adequate contact num- 
ber of a typical infection. The quan- 
tity aa is the probability that an 
individual in the exposed class be- 
comes infected. Thus Ro represents 
the total number of new cases gener- 
ated by a typical infection during its 
lifetime. 


Section 6.5 


1. (a) x,y are two species compet- 
ing for the same food supply, grow- 
ing logistically in the absence of the 
other; (b),(c) (0,0) is unstable, (0, 2) 
is stable, (3,0) is stable, (1,1) is a 
saddle; (d) none; (e) see figure; (f) 
one of the populations will die off and 
this result depends only on the initial 
conditions. 


Nf Aa | rere 


3. (a) x is prey with logistic growth 
and y predator; (b),(c) (0,0) is a sad- 
dle, (3,0) is a saddle, (2,1) is a stable 
spiral; (d) none; (e) see figure; (f) for 
non-zero initial populations, all solu- 
tions approach a stable point; this is 
likely a result of the coefficients of ry 
in the two equations being the same 
(not realistic). 


ee ee ee 
of Pn ee a ee 
ebb bd Li 2 
Sub bd ¢ Aa ee ee 
bib bb Ye He ee ee HS 
VU a a gv eee ee 
vo bly WO YE free 
gue V VV dg eee ee 
an VA QY feo ee 
rah 
Zi 
é 


—————— 


MO|4 2 —» — sie ee 3 2 2 2 en 


6.5443 


5. (a) x is prey with logistic growth, 

y predator, d measures quickness of 
predator death; (b),(c) (0,0) is a sad- 
dle, (1,0) is a saddle for 0 < d < 
1 and stable for d > 1, (d,1 — d) 
relevant only when 0 < d < 1 and 
stable for this condition; (d) (1,0) 
and (d,1 — d) undergo a transcriti- 
cal bifurcation with each other when 
d = 1; (e) see figure; (f) for non-zero 
initial populations, all solutions ap- 
proach a stable point for d < 1 and 
approach (1,0) for d> 1. 
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6.545d>1 


Chapter 6 Review 


1. True. 


3. True because the trajectories are 
projections of the solutions. 


5. False. There additionally needs to 
be a limit cycle created or destroyed 
when the sign switches. 


7. Stable node. 

9. Unstable spiral. 
11. Unstable spiral. 
13. Saddle. 

15. Unstable spiral. 
17. Unstable spiral. 
19. Unstable spiral. 


21. At = —27, A2,3 = —9,—9; Sta- 
ble node. 


Answers to Odd Problems 


23. Ay = 3, A2 = —2,3 = 2: Sad- 
dle. 


25. Ay = —27,A2 = —18,A3 = —9; 
Stable node. 


(0,1) is a saddle, (0,—1) is a linear 
center; the phase portrait suggests 
it’s a nonlinear center. 
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Chapter 6 Review #27 (iii)-(iv). 


29. (i) (a*,y*) = (0,0), (0, 2), (—1, 1); 
(ii) (0,0) is a saddle, (0,2) is a sad- 
dle, (—1, 1) is linear center; the phase 
portrait suggests it’s a nonlinear cen- 


ter. 
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Chapter 6 Review #29 (iii)-(iv). 


31. Saddlenode bifurcation at r = 
0. 


33. Subcritical pitchfork bifurca- 
tion. 


35. (a) N* = A/y; (b) the limiting 
system is constant so we can substi- 
tute S = N*-I = 4-I; (ec) I* =0is 
stable when 6 < a+ py and unstable 


for B > at p, I* = “252-4 is not 


Answers to Odd Problems 


biologically relevant for 6 < a+ yu 
and is biologically relevant and sta- 
ble for 8 > a+ p; (d) Ro = Bo. 
Section 7.1 

1. 2(1 — U4(t)) 

3. 5U6(t) 

5. 2(Us(t) — Ur(t)) 


7. ¢(1 — Us(t)) + Us(t) 


9. t(1 — Ui (#)) + Ui (t) — U2(t) 
11. 1+ U2(t) + Us(t) — 3U5(t) 
13. cos0=1 

15. e? 

17. 2 
19. 1-e? 
21. 1 
Section 7.2 
1. P(sy= 3 


3. F(s)=a-2 
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—4s 
21. F(s)=5, 
23. F(s) = 2(1— 71) 
25. F(s) = S(e-9* —e-**) 
27. F(s) = 4(1—e7-**§ + e-®*) 


31. F(s) _ ait ea) Bec" 


33. F(s) = 


ao, 
s?ta?2 


35. (c) $ — arctan s 


31. (a) [= (b) Say (e) Zon 


39. Use the linearity property of the 
Laplace transform. 


Section 7.3 


1. f(t) =3sintcost 


= $(1—cos V2t+V2sin V2t) 


) 
) = 7t(t + De“* 


13. F(s)=3-2 


s3+4s 
17. F(s) = =e 
19. F(s) = apipsz9 


21. y(t 


23. y 
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25. y(t) = 2e~* (cos 2t + 2 sin 2t) 
27. y(t) = =1(12te’ + Se — 15)e% 


29. y(t) = ze" (49e™ sint 
— Te" cost + 4e7! — 4) 


31. y(t) = qge’(114te* — 209e7! + 
1987" + 153e’ — 178) 


Section 7.4 
1. F(s) => wz? 
3. F(s) = Grae 


1 — 2t)e—# 


25. The graph is that of Up be- 
+ 

cause ha 6(v)dv = 1 so that f(t) = 

ihe d(v)dv = 1 for t > 0. 


29. x(t) = cos 2t + $U4,(t) sin 2t 


31. x(t) = 2e*sint — ge~* cost + 
2 sint + } cost —Uz(t)e'**/? cos 2t 


Answers to Odd Problems 


33. (a) f(t) represents a forcing of 
the support with 1 for t < 1, 2 for 
1<t< 2, and 0 otherwise. 


-~o.6 4 


7.44#33(c) 

(c) The solid black curve is the un- 
forced solution while the dashed blue 
curve is the forced solution. 


Section 7.5 


1. pole: s=4 


3. poles: s = +27; zero: s = —2 
5. poles: s = —1,—2; zeros: s = —2 
7 


. poles: s = —1+%; zero: s = —3 


2 
9. H(s) = 43s 


2 


A. (3) = 25a 

13. H(s) = ROstO 

15. H(s) = ayy => poles s = 
+37 => solutions oscillate. 

17. H(s) = »tis > poles s = 


—1,-2 = solutions decay. 


19. H(s)= a = poles s = 
+2i = solutions oscillate. 


s?7-1 


21. H(s) => 5242842 > poles &s= 
—1+i7= solutions decay with oscil- 
lations. 


3 2 
23. H(s) = as. > poles 
s= sb solutions grow 


without bound. 


Answers to Odd Problems 


25. s =0,+2i = oscillatory behav- 


Problem 25(a). 


27. s = —2+3i => damped oscilla- 
tory behavior 


Problem 27(a). 


29. s = +i = oscillatory behavior 
Im 


Problem 29(a). 


31. s = —1+iV/2 => damped oscil- 
latory behavior 


Im 


-142i 
[+23 x 


-1-2i X 


Problem 31(a). 


Fo/m 
33. (a) H(s) = ape 
. = Fo/m 
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35. (a) H(s) = aartseae: 


_ bw 
H(w) v/b?w2+m? (w?—w? )? 


Section 7.6 


1. x(t) = 2e’-e% +2, y(t) =e4(1- 
e') 


—e~'(3te’ + 1), 


x(t) = 
=e '(1—e* + 2te) 


3. 

y(t) 
5. a(t) = e'(5e3*—2), y(t) = 4e*(e?*#-— 
1) 
7. a(t) = 2cost + 8sint, y(t) = 
cost — 13sin¢ + sinht 


9. x(t) = 2e-**(e' +1), y(t) = 34+ 
t 4) 


11. x(t) = —3e' +2, y(t) = —2e'-8 
13. (c) 2(t) = —44+4-+45t—-20?+5e# 
Section 7.7 

i= 
3. 75g ((4t8¢? — 3) + 3sin 4t) 

5. t+ tUo(t) 

7. f(t) =e "*(ef — 1) 

9. f(t) = 2sin2(2) 


11. f(t) = 24 (9t? — 6t — 2e~* + 2) 


17. (a) sinkt(cosktsint + sinkt — 
cost sin kt), (b) sin kt(— cos kt 

+ cost cos kt + sintsin kt), 

(c) cos kt(cos kt sin t + sin kt 
—costsin kt), 

(d) Stsin kt 


Chapter 7 Review 


1. False. See Theorem 7.1.3. 
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3. True. See Theorem 7.3.1. 


5. True. Uniqueness of Laplace trans- 
forms. 


7.4 

9. F(s)= 3 

11. F(s) = as 
13. =p 

15. aR 

17. tey 

19. 2 

21. 1+e73 

23. 1 


25. s = +2 = solutions grow with- 
out bound; ad +1) 


27. s = —3,—3 => solutions decay 
without oscillating; 5(1 — 3t)e~** 


29. s = —4+i% => damped oscilla- 
tions; 3e~*' sint 


31. H(s) = Axis > poles s = 
—2,—3 = solutions decay; no zeros. 
Im 


Problem 31(b). 


= 4s+8 
= Gyisis)etap — Poles 
§ = —2+2i, +i = solutions oscillate; 


e * will have no effect. 


? 


Answers to Odd Problems 


-2-21 X 


Problem 33(b). 

35. x(t) = e’(e* + 17) 

37. x(t) = 2 sin 9t + cos 9t 

39. x(t) = 3e~ ‘(sin 2t + 2 cos 2t) 


Al. x(t) = =e?" (47e%—72e¢—15t— 
20) 


43. x(t) = e-**(—390te**+67e%*4 


180 
455e7* — 135e* — 207) 
45. N'(t) = rN — (Uo _ U1) - 30- 
(1 — t), N(0) = 20. No, because the 
solution never reaches 0. 


47. Follow steps in 7.2 Example 3. 


49. (a) I(t) = 2(U, — U2)(1 
e-FUL), (b) I(t) = Uaebpe RUE. 
(Le®/" cost — Re®/* sint — L 


53. x(t) = ae 1" (77e% — 144e” — 


59), y(t) = sqee” 1°" (756e1!—385e% — 


10807! — 236) 


55. a(t) = $(3—5e™*), y(t) = —2(4+ 
e2t) 


ay. ae 

59. 3, (4t(8t? — 3) + 3sin 4¢) 
61. f(t) =e-*(e’ - 1) 

63. f(t) = Zsin?t 


65. f(t) = <g(e7* + sin 8t — cos 8t) 


Answers to Odd Problems 
Section 8.1 
1. R=10,/ = (—10,10) 
3. R=co,I = (—0o0, 0) 
9. |a| <1 


Section 8.2 


11. y=1+2(e@-1)+4(2-1)? 
2 (x —1)? +. 

x at 
13. y=1-2-24+% 


Section 8.3 


1. «=0 and « =3 are regular 
singular points 


3. « = —2 is a regular singular 
point; x = 0 is an irregular singular 
point. 


5 + is a regular singular 
point; x = 0 is an irregular singular 
point. 


7. Ts(x) = 5a — 20x? + 162° 
To(x) = —1 + 182? — 48a4 + 3226 


Section 8.4 
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n 


1. Y=C1 eam tty 


n+1 
. y = 3c,22 6 2 et) ome” 
n-17,_ 
+eg07* (1 was ose”) 


5. yi(z) = co (—14+ 4) 


2 we 4 
yo(a) = co (e- + 5-4); 
Y = C1Y1 + C2Y2 


yo(x) = Co 
Y = C1Y1 + C2Y2 


9. y(t) = 41 Pg (- 
y = cyyi(“) + c2(y1 (2) Inz 

1 eg 
_2 Ye (61) ) 


(n!)? 
11. yy (2) =2+27, 


y =c1yi(x) + co(yi(x )Ina 
n41 ) 


—272 _ na ae 


Section 8.5 


ay" Taz? 


1. Apply Ratio Test. 
5. y= ne sy = Vou! as a, 
gi/? w (8 /Aua¥ 


+ 


gol 2yl— 
HD es / 


substitute and sinaplit 
= \/cos @\/z => u = cos z; again, 


sbeette and simplify. Similarly, 
Y= Vsina./z > u= sing. 

i ary 4 pW 4 9? y=0 
Chapter 8 Review 

1. False. See Theorem 8.1.1. 


3. If you think this is true, then you 
have missed the point of this chapter. 


5. False, check out Taylor’s theorem. 
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9. y=3+4 12x 4 12x? + 823 
+4Ant +... 


+ og + 
13. y=otar+e3 4 
32° 
a ake eae 
15. y= 2+ 16x + 25627 + 48878 
286736 4 1 .,, 
3 
17. y= A(x — 1) + 7(x — 1)? 4 
= ( iB 23 (a 1)4+ 
19. y= cred ( — 2 4 oe...) 


+ena ( — 2 4...) 

2 4 
20. y= cre? ( — 3 4 oe...) 
toon (1-28 + 9...) 
21. y= (l+a+ 2+...) 
+¢203 (1+ +55 -...) 


Appendix B.1 


» (a) La) = [4 


-7 19 
4 AB=[% Ee 
1-6 -14 
5. AB=|17 13 
9-2 10 
9 8 -1L 
BAS |i) = —3 
6 -2 12 
0 8 -2 
7,D-EB=|-6 -1 2 


Answers to Odd Problems 


6 0 
9. | -24 

22 

2 —22 12 
11. | 22 4 -2 

4 4 2 
13. TrE =3 


15. Not possible because the matri- 
ces are different sizes. 


1-14 
17. | 5 0 2 

23 1 
19. Not possible: Number of columns 
of A (2) does not equal the number 


of rows of A (3). 


326 1 
oe eee a 
17-8 19 
i2 -3 
23. AB=|-4 5 
4 1 
12-63 
= E 4 | 


27. Not possible: Number of columns 
of A (2) does not equal the number 
of rows of EF (3). 


—6 39 —27 
29. | 26 —-1 13 
10 19 —7 
31. 55 
33. 64 
35. 1815 
37. 55 


Answers to Odd Problems 
Appendix B.2 
1. Yes, in row-echelon form. 
3. No, not in row-echelon form. 


5. Yes, in row-echelon form. 


oe FR 
oOo © 
i | 


=> infinite solutions, 7; = —F(1 + 
3x3), 22 = z(1 bes 4x3) 


15. Determinant is zero, so no so- 
lution. 


3 2 1 
V7. t= Y= TD 2 1 
19. r=l1,y=0,z7z=2,w=0 
—1-2 
a [2] 


7 -2 
il 
23. 5| 2 | 


COE 


—32 —22 6 
25.5| 7 5 -1 
-5 -3 1 


Section B.3 
1. (@) [e/a] [3] 
© [sf@ [4]. 


8. (@) [2]: | a 


5. (a) Ee (b) panel 


1-3/3 —1-3V3 
(c) a] 3-3 | 
4 2 


ro [2B [8] 


foo [i] 


778 Answers to Odd Problems 


i 

3. (a) |-3 -3 -3], 
—3l 
9 

(b) lula =| 5 
3 


5. Matrix of eigenvectors is P = 
lo | , which is not invertible. Hence 


P~! does not exist. 


— 3+iV3 3-iV3 
= 2 2 . 
: | 1 1 : 
25 ltivs 9 
P-AP= @. Gas 
2 
—201 500 


9.P=| 0 10|;P-!AP= 1030 
3 00 002 
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